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1. Point SET TOPOLOGY Basics 
As usual we will let X and Y be sets and P(X) denote the power set of X. 


Definition 1.1. A collection of set T C P(X) is a topology on X if 

1. 0,X €7, 

2. 7 is closed under finite intersections, and 

3. T is closed under arbitrary unions. 

The members of 7 are called open sets and the sets C C X such that C° € 7 are 
called closed sets. We will often write V C, X to denote that VE 7 andCLl X 
to indicate that C' is a closed subset of X. 


Example 1.2. Suppose that X = {1,2}, then 

1. 7 = {0,X} (Trivial topology on X), ™% = {0,X,{1}}, m = {0,X, {2}}, 
T3 = {0,X, {1}, {2}} - Discrete topology are all topologies on X. 

2. Suppose (X,7T) is a topology space and Y Cc X. Then ry = {UNY:U € This 
a topology on Y called the relative topology on Y. (Notice that the closed 
sets in Y relative to Ty are precisely those sets of the form CMY where C is 
close in X. Indeed, B C Y is closed iff Y \B=Y NV for some V € 7 which 
is equivalent to B=Y\(YNV)=YNV* for some V € 7.) 

3. Suppose that X is a set and € C P(X) be a collection of subsets of X. We 
let T(E) be the smallest topology on X containing €. If r = 7(E€), we call 
€ asubbase for the topology T. 


Proposition 1.3. Given E C P(X), T(E) consists of arbitrary unions of finite 
intersections of elements from E U {X, 0}. 


Proof. Let 7 Cc P(X) denote the collection of sets consisting of arbitrary unions 
of finite intersections of elements from € U {X,0}. Then 7 C 7(E) so to finish the 
proof it suffices to show that 7 is a topology. 

Suppose {A; : i € I} and {B; : 7 € J} are collection’s of sets which are finite 
intersections of the elements in € U{X,@}. Set 


A=|JAi and B= [J B;. 
ie. jet 
Then 
ANB=|J{AinBj:i€Iandje J}er 


So 7 is closed under finite intersections, it is obviously closed under unions and 
contains X,(). That is 7 is a topology. ™ 
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Definition 1.4. We say € is a base for a topology if # € E€, X = UE and for all 
U,V €€, 
UNV=|({W:We€é and W CUNV}. 
Suppose that € is a base for a topology and {U;};_, C € and N?_,U; #0. Then 
for « € (Uj, there exists W; € € such that « € W, C U; 1 Uz. Similarly, there 
exists Wa € € such that « € Wo © Wi, NU3 C Uy NU2 U3. Continuing inductively 


this way we find there exists W,,_1 € € such that « € W,_1 C M,U;. This shows 
that 


(1.1) Mai =| {Ws W € € and W CL, U;}. 


The proof of the following proposition is an easy consequence of Eq. (1.1) and 
Proposition 1.3. 


Proposition 1.5. If € is a base for a topology then the general element of T(E) is 
of the form V = UB where BC E. 


Example 1.6. Suppose that X = {1,2,3,4} and € = {A := {1,2}, B := {2,3}} 
in which case 
T(E) = {AN B,A,B,AUB,X, pO}. 
If € = {{1,2}, {2}, {2,3},0, X} then & is a base for 7(E). 
Example 1.7. Let (X,) be a metric space and let 
Ep ={B,(r): x € X andr > O}U{X,G} 

where 

Ba(r) = {ye X: p(z,y) <r}. 


Then €, is a base for a topology which we denote by 7, and call the induced topology 
on (X, p). Notice that V is open in this topology iff for all x € V, there exists e > 0 
such that B,(e) C V. 


Proof. To prove that €, is a base for a topology we must show: for any x,y € X 
and €,6 > 0 such that B,(€) B,(6) #9, then for all for all z € B,(€)B,(6) there 
exists r > 0 such that B.(r) C Bz(e) NM By(6). This is fairly clear from Figure 1. 
The formal proof is as follows. If w € B,(r), then by the triangle inequality, 

plw,w) < plw,z) + plw,z) = p(a,z) +r 
and similarly 


p(¥,w) S pyz) +7. 
Therefore if we choose 0 < r < min(e — p(x, z),6— p(y,z)), then p(a,w) < € and 
p(y, w) <6, i.e. w € B,(€)M B,(6) showing that B,(r) C Bz (€)N By(6). = 
If (X, p) is a metric space we will also define the closed ball at x of radius r by 
C2(r) = {y EX : p(w,y) <r}. 


Let us now show that C = C,(r) is indeed closed. Recall that in a metric space 
that |o(x, y) — p(x, z)| < ply, z). Ify € C, then 6 := p(x, y)—€ > 0 and if z € B, (6) 


we have 


e<e+6—ply,z) < (x,y) — ply, 2) < pl, 2) 
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oy) 


FIGURE 1. Squeezing a ball in the intersection. 


which shows that Bs(y) MC = @. This shows that C° is open and hence that C is 
closed. 


Definition 1.8. Let A C X bea set. The interior, A°, of A is the largest open set 
contained in A, i.e. 


AM =| Ver: Vc A}. 

The closure A, of A is the smallest closed set which contains A, i.e. 
A=(\CDALCr X}. 

The boundary of A is the set 


dA=A\A®. 

We also define the set of accumulation points of A to be 

acc(A) ={w#eE X:VNA\{c} £0 for all V € 7 such that x € V+}. 
A set E C X is said to be nowhere dense if E° = 0). 

Let Ac X, then 
(ANS ae :VerandVc A} =(\c : C is closed C D AS} = AS. 

Similarly (A)° = (A°)°. Hence the boundary of A may be written as 
(1.2) dA = A\ Ao = An(A°)e = AN A?, 
which is to say OA consists of the points in both the closure of A and A‘. 
Definition 1.9. A set E C X is aneighborhood of a point x € X ifx € E® C E. 


Notation 1.10. Let 7 = {V € 7: « € V}. So 7, consists of all the open 
neighborhoods of x. A collection 7 C 7, is called a neighborhood base at x € X 
if for all V € tT, there exists W € 7 such that W CV. 
Proposition 1.11. Let AC X andxe X. 

1. IfV Co X and ANV =O then ANV =90. 
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2.2€A iff VNAFOD for all V € Tz. 
3. cE OA tfVAAFD and VO AS FO for all V € Ty. 


4, A= AUacc(A). 


Proof. 1. Since ANV =@), AC V¢ and since V° is closed, A C V°. That is to 
say ANV = 90. 

2. We will prove a ¢ A iff there exists V € T, such that VN A= 9. Ife ¢ A 
then V = Ae € and VN ACVNA=O. Conversely if there exists V € 7, such 
that VN .A=0 then by 1. ANV = 9. The third assertion easily follows from the 
second and Eq. (1.2). Item 4. is an easy consequence of the definition of acc(A) 
and item 2. 


Lemma 1.12. Let AC Y C X, let AY denote the closure of A in Y with its 
relative topology and A = A* be the closure of A in X, then AY = A* NY. 


Proof. Let x € Y then x € A” iff for all Ve 7rY,VNAF ). This happens iff 
for all U € TX, UN YN A=UNA FO which happens iff c € A*. That is to say 
AY a AP TY. 

An alternative proof may be given as follows: 

AY Sari pey sac BVSon(OnY ACC r x) 
BaPrninTe -AcOr Xh\=V nae 


wherein we have made use of the comments in Item (2) of Example 1.2. m 


Definition 1.13. Let {x,,} C X, we say tz, ~ rasn— coor lim,.o%, = 2 if 
for all V € t%, 2, € V almost always (abbreviated a.a.) by which we mean that 
{n: an ¢ V} is finite. 


Remark 1.14. (1) If 7 = {X,@} then given {z,} C X, t, — x for all x € X, ie. 
all sequences converge to all points x € X. 

(2)We say that a topology 7 on X is Hausdorff or T> if for all c 4 y € X there 
exists V € Tz and W € 7, such that VM W =. When 7 is Hausdorff the limits of 
convergent sequences are unique. Indeed if x, — « € X and y 4 x we may choose 
V € 7, and W € tT, such that V1 W =9@. Then z,, € V a.a. implies 2, ¢ W for 
all but a finite number of n and hence x, ~ y. 


Definition 1.15. Let (X,7) be a topological space. We say that X is first count- 
able iff every point x € X has a countable neighborhood base and we say that X 
is second countable iff there exists a countable base for T. 


Example 1.16. Every metric space is first countable. 


When 7 is first countable, we may formulate many topological notions in terms 
of sequences. The next Lemma is one such example. 


Lemma 1.17. Suppose there exists {xp yey C A such that lim, oy = x, then 
LE A. Conversely if (X,T) is a first countable space (like a metric space) then if 
xz €A there exists {t,}°-, C A such that lim, 0 fn = 2. 


Proof. As we have already seen x € A iff VM A 4 0) for all V € 7. If there 
exists {%p}°°., C A such that limn4oo Um = 2, then for all V € 7 we have zr, € V 
a.a. so that VN A #0. This shows that x € A. 

For the converse we now assume that (X,7) is first countable and that {V,,}°~_, 
is a countable neighborhood base at x such that Vj D Vo D V3 D .... Then if x € A, 
there exists x, € V, 7 A for all n. It is now easily seen that xz, ~ x asn— oo. 
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p 
on X. Then B,(e) C C,(e). It is not generally true that B,(¢€) = C,(e). For example 
let X = {1,2} and p(1,2) = 1, then B,(1) = {1}, By (1) = {1} while C)(1) = X. 
Another counter example is to take 
X ={(c,y)€R:2=0orz=1} 

with the usually Euclidean metric coming from the plane. Then 

Boo) (1) = { (0, y) eR?: ly| < 1} , 

Booo)(1) = {,y) € R*: [yl <1}, while 


Co,0) (1) = Boeo,o) (1) U {(0, 1)}. 
In spite of the above examples, Lemmas 1.19 and 1.40 below shows that for 
certain metric spaces of interest it is true that B,(e) = C,(e). 


Example 1.18. Let (X,p) be a metric space and T = 7, be the induced topology 
( 


Lemma 1.19. Suppose that (X,|-|) is a normed vector space and p is the metric 
on X defined by p(x,y) = |x —y|. Then 


B,(€) = Cr(e) and 
OBz(e) = {y € X : p(z,y) = €}. 


Proof. We must show that C := C,(e) C B,(e) =: B. For y € C, let v=y—2, 

then 
lo] = |y— 2] = e(@,y) Se. 

Let a, = 1—1/n so that a, T 1 as n > o. Let yn, = 2+ anv, then p(x, yn) = 
Anp(z,y) <€, so that y, € B,(e) and p(y, Yn) = 1—a, — 0 as n = ov. This shows 
that yp, — y as n — oo and hence that y € B. = 
Definition 1.20. Let f : X — Y be a function between two topological spaces. 
Then f is continuous if f~'(V) is open in X for all V open in Y or equivalently 
f-1(C) is closed in X for all C closed in Y. We also say that f is continuous 
at x © X if for all W open in Y such that f(x) € W there exists V € T, such 
that f(V) C W, ie. x € f71(W)° for all W open in Y such that f(x) € W. 


Definition 1.21. A map f : X — Y between topological spaces is called a home- 
omorphism provided that f is bijective, f is continuous and f~! : Y — X is 
continuous. If there exists f : X — Y which is a homeomorphism, we say that 
X and Y are homeomorphic. (As topological spaces X and Y are essentially the 
same.) 


Lemma 1.22. Let f : X — Y be a function between two topological spaces. Then 


1. f is continuous iff f is continuous at x for all x © X 

2. IfE C P(Y) is a subbase for the topology onY then f is continuous iff f—'(V) 
is open in X for allV EE. 

3. Ifg:Y — Z is another continuous function then go f is also continuous. 


Proof. 
1. (=) Let V c, Y. Then for all x € f~'(V) there exists W, C, X such 
that f(W,) C V. and therefore 


PO i. Wee me 
xef-'(V) 
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(<=) Given x € X and V c, Y such that f(x) € V take W = f-1(V) c, X 
then « € W and f(W) CV. 

2. (=) Clear. (<) Recall that f-'(7(€)) = r(f7'(E)) where f-l(€) = 
{f-l(V) : V € €}. Thus if f-1(€) consists of open sets then f—'(7(E)) 
af MENS he Le: fe) Ste 

3. Suppose that V C, Z, then (go f)7'(V) = f-(g(V)) co X since 
ime Chere s 


Lemma 1.23. Suppose that f : X — Y is a map between topological spaces. Then 
the following are equivalent: 

1. f is continuous. 

2. f(A) c f(A) for all AC X 

3. f-1(B) c f-1(B) for all BC X. 


Proof. If f is continuous, then f~! (7) is closed and since A C f~'(f(A)) C 


f=! (7A) it follows that A Cc f-! (7(4)) . From this equation we learn that 


f(A) Cc f(A) so that (1) implies (2) Now assume (2), then for B C Y (taking 
A= f—1(B)) we have 


F(F-*(B)) C FF (B)) C FFB) CB 


and therefore 
(1.3) i (B).-eF (8): 


This shows that (2) implies (3) Finally if Eq. (1.3) holds for all B, then when B is 
closed this shows that 


f-1(B) c f-1(B) = f-*(B) c FB) 
which shows that 
f-"(B) = f-'(B). 


Therefore f—!(B) is closed whenever B is closed which implies that f is continuous. 
= 


Exercise 1.24. Suppose that A and B are closed subsets of a topological space X 
and f € C(A) and g € C(B) such that f = g on AN B. Show 


F@={ iG) it rep 
defines a continuous function on AU B. 
Solution. Let C be a closed set R or C depending on the context, then 
FC) = f-'(C)Ug"*(C). 


By the continuity of f and g, f~!(C) and g~!(C) are relatively closed sets in A and 
B respectively and since A and B are closed, it follows that f—!(C’) and g~!(C) are 
closed in X as well. Therefore F~!(C) is closed in X and hence closed in AU B, 
showing the Fis continuous. @ 
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Proposition 1.25. If f : X — Y is continuous at x © X and lim,_.., In = @ EC X, 
then limn—oo f(tn) = f(x) € Y. Moreover, if there exists a countable neighborhood 
base 7 C Tz, then f is continuous at x iff lim f(an) = f(x) for all sequences 


{tn} CX which are convergent to x. 


Proof. If f : X — Y is continuous and W € Ty) C P(Y), then there exists 
V € 7t, such that f(V) Cc W. Since vz, — x, tn € V a.a. and therefore f(r,) € 
f(V) CW aa, ie. flan) > f(x) asn— o. 

Conversely suppose that 7 = {W,}92, C 7. is a countable base and 
dim. f (an) = f(x) for all sequences {x,,} C X. By replacing W,, by Win---AW, 


if necessary, we may assume that {W,, Saar, is a decreasing sequence of sets. If 
f were not continuous at x then there exists V € T(z) such that « ¢ f~'(V)°. 
Therefore, W,, is not a subset of f—!(V) for all n. Hence for each n, we may choose 
In € W, \ f~'(V). This sequence then has the property that 2, — x as n — oo 
while f(x,) ¢ V for all n and hence limp. f(tn) # f(x). 


1.1. Connectedness. 


Definition 1.26. (X,7) is disconnected if there exists non-empty open sets U 
and V of X such that UNV = @ and X = UUV. We say {U,V} is a disconnection 
of X. The topological space (X,7T) is called connected if it is not disconnected, 
i.e. if there are no disconnection of X. If A C X we say A is connected iff (A, 74) 
is connected where 7, is the relative topology on A. Explicitly, A is disconnected 
in (X,7) iff there exists U,V € 7 such that UN A#0,UN AZO, ANUNV =O 
and ACUUY. 


The reader should check that the following statement is an equivalent definition 
of connectivity. A topological space (X,T) is connected iff the only sets A C X 
which are both open and closed are the sets X and 0. 


Remark 1.27. Let AC Y C X. Then A is connected in X iff A is connected in Y. 


Proof. Since 
TA={VNA:VCXF={VNANY: VCX}={UNA: UG Y}, 
the relative topology on A inherited from X is the same as the relative topology on 
A inherited from Y. Since connectivity is a statement about the relative topologies 


on A, A is connected in X iff A is connected in Y. m 
The following elementary but important lemma is left as an exercise to the reader. 


Lemma 1.28. Suppose that f : X — Y is a continuous map between topological 
spaces. Then f(X) CY is connected if X is connected. 


Proposition 1.29. Let (X,7) be a topological space. 
1. If BC X is a connected set and X is the disjoint union of two open sets U 
and V, then either BCU or BC Y. 
2. a) If AC X is connected, then A is connected. 
b) More generally, if A is connected and B C acc(A), then AU B is con- 
nected as well. 
3. If {Ea}aca is a collection of connected sets such that (.\,c, Ea # W, then 
Y :=Uscea Ea ts connected as well. 
4. Suppose A,B C X are non-empty connected subsets of X such that ANB F 0, 
then AU B is connected in X. 


. Let Y:=U 
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5. Every point x € X is contained in a unique maximal connected subset Cy of 


X and this subset is closed. The set Cy, is called the connected component 
of x. 


Proof. 
1. Since B is the disjoint union of the relatively open sets BM U and BN V, we 


must have BDU = B or BN V = B for otherwise {BN U,BOV} would be 
a disconnection of B. 


. a. Let Y = A equipped with the relative topology from X. Suppose that 


U,V Co Y form a disconnection of Y = A. Then by 1. either A C U or 
ACV. Say that A C U. Since U is both open an closed in Y, it follows that 
Y =ACU. Therefore V = ) and we have a contradiction to the assumption 
that {U,V} is a disconnection of Y = A. Hence we must conclude that Y = A 
is connected as well. 


b. Now let Y = AU B with B C acc(A), then 
AY = ANY =(AUVacc(A))NY = AUB. 


Because A is connected in Y, by (2) b. Y = AU B = A” is also connected. 
aca Ha: By Remark 1.27, we know that E, is connected in Y for 
each a € A. If {U,V} were a disconnection of Y, By item (1), either E, C U 
or Ey C V for all a. Let A= {a € A: Ey C U} then U = Ugea Eg and 
V = Usea\a La. (Notice that neither A or A \ A can be empty since U and 
V are not empty.) Since 


0=UNV =|Jacea,seac (Ea N Es) > (| Ea #9. 


acA 


we have reached a contradiction and hence no such disconnection exists. 


. Let Y = AUB and, for sake of contraction, suppose that Y were disconnected. 


Since A and B are connected, it follows from item (1) that {A, B} is the only 
possible disconnection of Y. In particular it follows that AY = A. On the other 
hand we have seen that AY = ANY = ANB. Therefore A = ANB. But since 
{A, B} is a disconnection, § = AN B = AN B ¥ 0 which is a contradiction. 


. Let C denote the collection of connected subsets C C X such that x € C. 


Then by item 3., the set C, := UC is also a connected subset of X which 
contains x and clearly this is the unique maximal connected set containing x. 
Since C, is also connected by item (2) and C, is maximal, C, = Cy, i.e. Cy 
is closed. 


Example 1.30. The connected subsets of R are intervals. 


Proof. Suppose that A C R is a connected subset and that a,b € A with 


a < 0b. If there exists c € (a,b) such that c ¢ A, then U := (—o0,c)N A and 


Vi= 


(c,00) A would form a disconnection of A. Hence (a,b) C A. Let a := inf(A) 


and @ := sup(A) and choose a,, 38, € A such that a, < 6, and a, | a and 
Bn t B as n— oo. By what we have just shown, (an, ,) C A for all n and hence 
(a, 3B) = USL 1 (An, Gn) C A. From this it follows that A = (a, 3), [a, 8), (a, ] or 
[a, 3], i.e. A is an interval. 
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Conversely! suppose that A is an interval, and for sake of contradiction, suppose 
that {U,V} is a disconnection of A with a € U, b € V. After relabeling U and 
V if necessary we may assume that a < b. Since A is an interval [a,b] C A. Let 
p = sup({a,b] OU), then because U and V are open, a < p < b. Now p can not 
be in U for otherwise sup ([a,b]U) > p and p can not be in V for otherwise 
p < sup([a,b] MU). From this it follows that p ¢ U UV and hence A 4 UUV 
contradicting the assumption that {U,V} is a disconnection. 


1.2. Separable Spaces. 


Definition 1.31. A set A CX is said to be dense if A = X. A topological space 
X is separable if there exists a countable dense subset A C X. 


Example 1.32. he following are example of countable dense sets. 


1. The rational number Q are dense in R equipped with the usual topology. 

2. More generally, Q? is a countable dense subset of R@ for any d € N. 

3. If (X, ) is a metric space which is separable then every subset Y C X is also 
separable in the induced topology. 


Proof. (3) Let A Cc X be a countable dense set and let A = {x,}°2,. Set 
p(x, Y) = inf{p(z,y): y € Y} the distance from x to Y. Recall that p(-,Y):X > 
(0,00) is continuous. Indeed, if x,z € X and y € Y then 


(1.4) p(z,Y) < p(z,y) < pla, z) + plz,y). 
Taking the inf over y € Y in (1.4) implies 
p(e,¥) < p(x, 2) + p(z,¥) or 
(1.5) p(z,Y) — p(z,Y) < plz, z). 
Equation (1.5) along with Eq. (1.5) with x and z interchanged shows that 
lp(x,¥) — p(z,Y)| < plz, z) 


which certainly implies that p(-, Y) is continuous. 

Let €, = p(an,Y) > 0 and for each n let yn € Bz, (+) NY if & = 0 otherwise 
choose yp, € Bz, (2én) OY. Then if y € Y and e > 0 we may choose n € N such that 
P(Y,2n) < €n < €/3 and 4 < €/3. If e, > 0, p(Yn, In) < 2en < 2€/3 and if €, = 0, 
P(Yn; Ln) < €/3 and therefore 


PLY: Yn) S PYs%n) + p(n Yn) < € 
This shows that B = {y,, }?2, is a countable dense subset of Y. = 


Proposition 1.33. Every separable metric space is second countable. 


1(An Old proof.) Conversely suppose that A is an interval which for sake of contradiction is 
not connected. Let U,V Co R such that ANU and AN V is a disconnection of A. Let ae ANU 
and b€ ANV and notice that a 4 b because ANU NV = @. With out loss of generality we may 
assume that a < b. Since A is an interval, we know that [a,b] C A. 

Now let p = sup{[a, 6b] NU}. We will now finish the proof by showing that p€ ANUNV which 
will contradict the assumption that AN UNV = 9. By Lemma 1.17 pe€é UN A® and by (1) of 
Lemma 1.12, UN A =U An Since UN A is closed in A, it follows that p€ UN Tee UNA. 
From this it follows that p = 6 for otherwise sup{[a,b] 7 U} > p. But then p = b € VN A and 
hence p€ ANUNV. 
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Proof. Let {z,,}°2, be a countable dense subset of X. Let € = 
{X,0} U {Bz,,(rm)} C Tp, where {rm}9°_, is dense in (0,00). Then € is a 
mn=1 
countable base for t,. To see this let V C X be open and x € V. Choose 
€ > 0 such that B,(e«) C V and then choose x, € B,(e/3). Choose r, near 


e/3 such that p(z,2%n) < Tm < €/3 so that x € By (rm) C V. This shows 
V=U{Bz, (rm): Bu, (7m) CV}. © 


1.3. Bounded Functions as Metric Spaces. 


Definition 1.34. Let B(X,C) denote the bounded functions in C* and B(X,R) 
denote the bounded functions in R* . We may equip these spaces with the supremum 
(or uniform) norm: 


Il flloo = IIfllu = sup{|f(x)|:# € X} 


and let p be the associated “uniform metric,” 


p(F,9) = If — glloo for all f,g € B(X) 
where B(X) is either B(X,C). or B(X,R). 
Lemma 1.35. The metric space (B(X), p) as defined above is complete. 
Proof. It is easily checked that p is a metric. For completeness, let {f,}°°, be 


a Cauchy sequence in B(X) then { f(x) }92, C C is Cauchy for all « € X. Hence 
by completeness of C or R, f(z) = lim f,,(z) exists for all 2 € X. Noting that 


f(x) — frl2)| < |F(@) — fm(2)| + | fm (2) — fn(2)| 
< | f(x) a fm(z)| + Il fa =4 Falloo, 
we have 
Taking the sup of the left member of this equation over x and the letting n — oo 
gives 
le Fal lee in lfm — friloo 7 0asn— co 


wherein we have used {f,,} is Cauchy in B(X). Therefore, f, — f uniformly and 


so that f €¢ B(X). = 


Notation 1.36. Given a topological space X, let C(X) denote the continuous 
functions from X — R or X > C. Also let BC(X) = C(X)N B(X), ie. the space 
of bounded continuous functions on X. 


Proposition 1.37. The space BC(X) is a closed subspace of (B(X),p), where p 
is the sup-norm metric. 


Proof. We will prove this by showing that BC(X) C BC(X). So let f € BC(X) 
and choose f,, € BC(X) such that f,, of fag th OS) 1: P(f, fn) — 0. We will 
shows that f € C(X) and hence f € BC(X) showing BC(X) Cc BC(X). 
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Let « € X and € > 0 be given and choose N EN so large that || f — frlloo < €/3 
for all n > N. Then for any in X we have 


f(z) — FMI SIF@) — fa@)| + fa(@) — fro) + 1FY) — fr) 
< If — frlloo + |fn(2) — fn(y)| 


< *6€+|falz) — falv)l 


Choose V open in X such that « € V and f,(V) C By, (2)(€/3), ie. so that 


\fn(«) — faly)| < €/3 for all y € V. Then 
2 
f(x) — FQ) < F +5 =e for ally eV. 


Since € > 0 is arbitrary, we shown that f is continuous at 7. @ 


Remark 1.38. Notice that BC(X) is complete since it is easily verified that a closed 
subset of a complete metric space is also a complete metric space. 


1.3.1. Application: An ODE Existence Theorem. In this section suppose that 
R and R¢ are equipped with the standard Euclidean topologies that f : Rx R¢ - R 
is a continuous function. Further assume there is a constant K < oo such that 


\f(t,2) — f(t,y)| < Ka — y| for allt € R and z,y € R?. 
We wish to find a C! function y : R > R¢ solving the ordinary differential equation, 
(1.6) y(t) = f(t, y(t)) with y(0) = yo 


where yo is a given point R?. It is easily checked that solving Eq. (1.6) is equivalent 
to finding a continuous function y : R > R®@ such that 


(1.7) y(t) = yo + if f(r.y(r))ar. 


In general no such solution exists. However, if we restrict t in some neighborhood 
of 0, and only require y to be defined on this neighborhood, solutions do exist. In 
particular we have the following theorem. 


Theorem 1.39. Keeping the notation and assumptions above. For all0 < T < 
K~—", there exists a unique solution y : (—T,T) — R¢@ to Eq. (1.6). 


Proof. Let X denote the complete metric space of bounded functions from 
(—T,T) — R?¢ equipped with the uniform metric: 


p(z,y) = sup |a(t) — y(t). 
te(—-T,T) 


For x € X, let 
t 
s(e)() =w +f Flr.2())ar 
0 
and notice that for x,y € X and t € (—T,T) that 


IS(2)(#) - S@)(O| = | [ex - fever 


< | K|x(r) — y(r)|dr 
0 


< TK||z — ylloo: 
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FIGURE 2. An almost length minimizing curve joining z to y. 


Taking the sup of this equation over ¢t shows that 


(1.8) I|S(z) — SY) loo < a||z — ylloo 
where a = KT < 1. This equation with y = 0 implies that 


I|S(@) loo S$ [1S(0)loo + I1S(@) — S(O)Iloo S |]$(0)Iloo + @l|2#Ilo0 < 00. 


Therefore S : X — X is a contraction and therefore by the contraction mapping 
principle (see your homework) has a unique fixed point, y. This is to say 


u(t) = S(y)(t) =o + i f(r), y(7))dr for all t € (7,7). 
|_| 


1.4. Appendix on Riemannian Metrics. This subsection is not completely self 
contained and may safely be skipped. 


Lemma 1.40. Suppose that X is a Riemannian (or sub-Riemannian) manifold 
and p is the metric on X defined by 
p(x, y) = inf {€(c) : o(0) = x and o(1) = y} 


where l(c) is the length of the curve o. We define l(c) = co if o is not piecewise 
smooth. 
Then 


B,(€) = Cz(e) and 
OBz(€) ={y € X : p(a,y) =«}. 

Proof. Let C := C,(e) C B,(e) =: B. We will show that C Cc B by showing 
B° c C®. Suppose that y € B® and choose 6 > 0 such that B,(6)N B = 0. In 
particular this implies that 

B,(6)N Bz(6) = 90. 


We will finish the proof by showing that p(x, y) > ¢+6 > and hence that y € C°. 
This will be accomplished by showing: if p(x,y) < ¢+6 then B,(6)N Bz (6) #9. 

If p(x, y) < max(e,6) then either x € B,(6) or y € B,(e). In either case By (6) 
B,(€) #4 0. Hence we may assume that max(e,6) < p(x,y) <e+6. Leta >0bea 
number such that 


max(e,6) < p(a,y) <a<e+6 


and choose a curve o from x to y such that (7) < a. Also choose 0 < 6’ < 6 such 
that 0 < a—& < € which can be done since a— 6 < e€. Let k(t) = p(y,a(t)) a 
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continuous function on [0,1] and therefore k([0,1]) C R is a connected set which 
contains 0 and p(x,y). Therefore there exists to € [0,1] such that p(y,o(to)) = 
k(to) = 6’. Let z = o(to) € By(6) then 

(2%, 2) < L(|f0,0)) = &o) — Col ft0,1)) < @— plz,y) =a—6 <e 
and therefore z € B,(e)N B,(6) #9. = 


Remark 1.41. Suppose again that X is a Riemannian (or sub-Riemannian) mani- 
fold and 


p(x, y) = inf {€(c) : 0 (0) = x and o(1) = y} . 

Let o be a curve from x to y and let « = &(o) — p(x, y). Then for allO <<u<v<1, 

p(o(u),o(v)) S Col fu,v}) + € 
So if o is within € of a length minimizing curve from x to y that o|j,,.) is within 
€ of a length minimizing curve from o(u) to o(v). In particular if p(x, y) = (0) 
then p(a(u),a(v)) = €(A|u,r]) for allO <u<vu<1,ie. ifo is a length minimizing 
curve from x to y that o|,,,.j is a length minimizing curve from a(u) to o(v). 

To prove these assertions notice that 
p(z,y) +e = £0) = L(|f0,u)) + L(P|[uvj) + ECO f,1)) 

> p(x, o(u)) + €(|ju,v) + e(o(v),¥) 
and therefore 
(x,y) TET p(z, a(u)) _ p(o(v),y) 
(o(u),(v)) +e. 


2. NORMAL SPACES 


Definition 2.1. A topological space (X,7) is said to be normal or T; if: 


1. X is Hausdorff and 
2. if for any two closed disjoint subsets A, B C X there exists disjoint open sets 
V,W CX such that AC V and BC W. 


Remark 2.2. Suppose that X is normal and C C W Co X and C is closed. Then 
there exists U C, X such that 


CcuctUcW. 


Indeed, Since W° is closed and CM W* = @, there exists disjoint open sets U and 
V such that C C U and W° C V. Therefore C C U C V° C W and since V° is 
closed, we may conclude that CCU CU CV° CW. 


The converse of the above remark holds as well. Namely if for all C CW Cc, X 
with C closed, there exists U C, X such that C CU CU CW, then X is normal. 
To prove this, if A and B are disjoint closed set in X, then A C B° and B* is open, 
hence there exists U C, X such that 

NEDEUE BS 
and by the same token there exists W Cy X such that U CW CW Cc B®. Taking 
complements of the last expression implies 
BOWreweeU*, 
Let V=W°. Then ACUC, X,BCVCG, X andUNVCUNW =90. 
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Lemma 2.3 (Urysohn’s Lemma for Metric Spaces). Every metric space, (X, p), is 
normal. Moreover if A and B are disjoint closed subsets of X, then there exists 
f € C(X, [0,1]) such that f =0 on A and f =1 on B. 


Proof. Let p4(x) = p(x, A) and pg(x) = p(x, B) denote the distance from x to 
A and B respectively. We will show that 


pa(x) 
FO) = Fa) + pa) 
is the desired function. Since B® is open, if x ¢ B there exists an € > 0 such that 
B,(e) Cc B® and hence pg(x) > € > 0. Similarly if x ¢ A than pa(x) > 0 and 
therefore because A° U BS = X, 


pa(&) + pp(x) > 0 for all e © X. 


Therefore f is well defined and being the composition of continuous functions is 
continuous so f € C(X,[0,1]). It is now clear that and f(x) = 0 if x € A and 
f(x) =lifveB. 

The open sets, V = f—!(—o0,1/2) and W = f7'(1/2,00), are disjoint and 
ACVandBCW. g 


Theorem 2.4 (Urysohn’s Lemma for Normal Spaces). Let X be a normal space. 
Assume A,B are disjoint closed subsets of X. Then there exists f € C(X, [0,1)) 
such that f =0 on A and f =1 on B. 


We will prove this theorem after the next Lemma. The idea of the proof is to 
define f by its level sets. For motivational purposes, suppose that f € C(X, (0, 1]) 
such that f =0on A and f =1o0n B. Forr > 0, let U, = {f <r}. Then for r < s, 
U, C{f <r} CU, and since {f <r} is closed this implies that 


ACUPGUPCHf Src Ue." 


for all 0 <r <s <1. Therefore associated to the function f is the collection open 


set {U,},.9 with the property that A CU, CU, CU, C B® for alO<r<s<1 
and U, = X ifr > 1. Finally let us notice that we may recover the function f from 
the sequence {U;},., by the formula 


f(x) =inf{r > 0:2€U,}. 


Hopefully these remarks will help the reader understand the motivation for the 
proof of Theorem 2.4. For the remainder of this section let 


= fp" k= 1,9. OO ea 
{ 


r>0 


be the dyadic rationales in (0, 1]. 


Lemma 2.5. Suppose that (X,T) is normal and A, B are disjoint closed subsets of 
X. Then there exists {Ur},cp C T such that for allr < s in D, 


ACU, CU, CU, CU, = B’. 


Proof. Let U; = B°. By Remark 2.2 there exists Uj/2 Co X such that 
Ac Uyj2 C Ui /2 cU,. 
Similarly we may construct U;/2,U3/4 Co X such that 


A« Uj /4 © i /4 ¢ Uj /2 © Uy /2 ¢ Us/4 © Usy4 ¢ U; 
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and then we may construct U1 /g,U3/3,Us/s,U7/g Co X such that 


Ac Uy /8 © Ui ¢ Uj /4 © Uy 4 ¢ U3/g ¢ Us 8 ¢ Us /2 


C Uy /2 © Us ¢ Us 8 ¢ U3 © U3 4 ¢ Uz/g © O77 © Uj. 


It is now easy to continue (inductively) in this fashion to construct the desired 
sequence {U;},.cp C T. The details are left to the reader. ™ 

Proof. (Urysohn’s Lemma for Normal Spaces) Let {U;},.cy C T be as in Lemma 
2.5, U, = X if r > 1 and define 


f(x) =inf{r € DU [1,00): a € U,}. 


Notice that f(x) € [0,1] for all a € X, if x © A then f(x) = 0 since z € U, for 
all r € D and if x € B, then x ¢ U, for all r € D and hence f(x) = 1. So it 
only remains to show f is continuous. We will do this by showing that {f < a} 
and {f > a} are open sets for all a € R. This will shows f is continuous since 
E = {(a, co), (—00, a) : a € R} is a subbase for the topology on R. 

If x € X, then f(z) < a iff there exists r < a such that x € U, so that 


tee eo kerere.§ 


r<a 


Similarly, f(x) > a iff there exists r > a with x ¢ U,. Now ifr > a and x ¢ U, 
then fora<s<r,x«¢U, C U,. Thus we have shown that 


{f>a}= Lu; Cy 


s>a 


Theorem 2.6 (Tietze Extension Theorem). Let X be a normal space, AC X, 
—o0 <a<b<o and f € C(A, a, b]). Then there exists F € C(X, |a,b]) such that 
Bast 


Proof. By translating and scaling we may assume a = 0 and b = 1. We will now 
construct F' by a sequence of approximations. Firstly let B,C Cc A be the closed 
subsets of X defined by B = f~'([0, $]) and C = f-!([2, 4) By Urysohn’s Lemma 
choose g; € C(X, [0, $]), such that g, = 0 on B and g; = § on C. Let f, = f—gila, 
then fi(x) = f(x) for z € B,0< fi(z) < f(x) < 1/8 for x € f—'({1/3,2/3]) and 
0< fi(x) < 2/3 for x € C and thus 


0< fi < 2/3 0n A. 


Applying the same construction we may find g2 € C(X,{0,4]) such that fg := 
3 fi — ge|a satisfies 


0 < fo < 2/3 0n A. 


Continuing this way inductively we may find g, € C(X,[0, $]) and fn := 3 fn—1 - 
9n|4 such that 


0 < fn < 2/3 on A. 
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2 2 2 
f=fitn = 3 (fe + g2) +91 = giz + 392 +H 


22 2 2\? 5\? 2 
= 33 (fa + 93) yn += (5) fa (3) g3 4 392 tn 


Hence if we define F,, (x) := Raa (ume gx, then F,, converges uniformly to the 
continuous function 


Since |fn| < 2/3 on A, 


n—1 
|f —F| = lim |f-—F,|= lim (3) |fn| =0 on A, 


ie. f = F|,4. To finish the proof notice that, on X, 


co 2 k-1 2 oo 2 k-1 2 1 
< = — <S — et ah 
oa > (3) m<3>(3) 31-28 + 


k=1 k=1 


Corollary 2.7. Suppose that X is a normal topological space, A C X is closed, 
F € C(A,R). Then there exists F € C(X) such that Fla = f. 


Proof. Let g = arctan(f) € C(A, (—§, $)). Then by the Tietze extension theo- 
rem, there exists G € C(X, [—$, §]) such that G|4 =g. Let B= G-'({-3, $})) C 
X, then BM A = 9. By Urysohn’s lemma there exists h € C(X,[0,1]) such that 


h=1on Aand h = 0 on B and in particular hG € C(A, (—4, $)) and (hG) |4 = g. 


The function F = tan(hG) € C(X) is an extension of f. ™ 


3. COMPACT SPACES 


Definition 3.1. Let (X,7) be a topological space and A C X. We say a subset 
U Cc 7 is an open cover of A if A Cc UU. The set A is said to be compact if every 
open cover of A has finite a sub-cover, i.e. if / is an open cover of A there exists 
Uo CC U such that Us is a cover of A. (We will write A X to denote that 
Ac X and A is compact.) A subset A C X is precompact if A is compact. As 
usual, the reader should notice that A C X is compact iff (A,7,4) is compact. 


Definition 3.2. We say a collection F of closed subsets of a topological space 
(X,7) has the finite intersection property if N7o 4 0 for all Fp CC F. 


The notion of compactness may be expressed in terms of closed sets as follows. 


Proposition 3.3. A topological space X is compact iff every family of closed sets 
F CP(X) with the finite intersection property satisfies (\F 4 9. 
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Proof. (=) Suppose that X is compact and F C P(X) is a collection of closed 
sets such that () F = 0. Let 


U=F°:={C®: CEFF} cr, 
then U is a cover of X and hence has a finite subcover, Uo. Let Fo = US CC F, 
then NFo = so that F does not have the finite intersection property. 
(<=) If X is not compact, there exists an open cover U of X with no finite sub- 


cover. Let F =U°, then F is a collection of closed sets with the finite intersection 
property while ()7 =. = 


Proposition 3.4. Closed subsets of compact spaces are compact. 


Proof. Let F Cc X be closed and U be an open cover of F' then UU { F°} is an 
open cover of X. Therefore there exists Uy CC U such that Up U {F*} covers X. 
The finite collection of open sets Up is a finite subcover of F. 


Proposition 3.5. Suppose that (X,T) is a Hausdorff space, K X andx€ K. 
Then there exists U,V € T such that UNV =9, 2 €U and K CV. In particular 
K is closed. 


Proof. Because X is Hausdorff, for all y € K there exists V, € 7 and Uy € Tz 
such that Vy Uy =. The cover {Vy}, ¢% of A has a finite subcover, {V,},<, for 
some A cc Kk. Let V = U{V,: ye A} and U =N{U,: ye A}, then U,V € + 
satisfy « € U, K CV and UNV =¥9. This shows that K° is open and hence that 
K is closed. @ 


Proposition 3.6. If (X,7) is Hausdorff and compact then X is normal. 


Proof. Let A and B be closed disjoint subsets of X. By Proposition 3.4, both A 
and B are compact. By Proposition 3.5, for all x € B there exist Vi € T,, Uz Co X 
such that A C U, and U,V, = (. By Compactness of A, there is a finite set 
A cc B such that V = Uzgea Vz contains B. Let U :=NgeaUz € T, then UNV =O 
while ACU and BC V. @ 

The next Proposition contains some easily verified facts about compact sets. The 
proof is left to the reader 


Proposition 3.7. Suppose that X and Y are topological spaces. 


1. Suppose that A C X compact and f : X — Y is a continuous, then f(A) is 
compact in Y. 

2. The finite union of compact sets is compact. 

3. If X is compact and f € C(X), then f is bounded, i.e. C(X) = BC(X). 

4. If X is compact and Y is Hausdorff and f : X — Y is a continuous bijection 
then f is a homeomorphism, i.e. f—':Y — X is continuous as well. (Just 
show that f(C) CY for all CC X.) 


3.1. Compactness in Metric Spaces. Let (X,p) be a metric space and let 
Bi(e) = B,(e) \ {x}. Let us start with the following elementary lemma which 
is left as an exercise to the reader. 


Lemma 3.8. Let E Cc X be a subset of a metric space (X,p). Then the following 
are equivalent: 


1. © € X is an accumulation point of E. 
2. Bi(e)\NE FO for alle > 0. 
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3. Bz, (€) NE is an infinite set for all € > 0. 
4. There exists {,}°-_, C E\ {x} with lim, tn = 2. 


Definition 3.9. A metric space (X, p) is said to be e — bounded (e€ > 0) provided 
there exists a finite cover of X by balls of radius «. The metric space is totally 
bounded if it is € — bounded for all € > 0. 


Theorem 3.10. Let X be a metric space. The following are equivalent. 
(a) X is compact. 
(b) Every infinite subset of X has an accumulation point. 
(c) X is totally bounded and complete. 


Proof. The proof will consist of showing thata > b=>c> a. 

(a => b) We will show that not b > not a. Suppose there exists E C X,such 
that #(F) = co and E has no accumulation points. Then for all 2 € X there exists 
Ve € Tz such that (Vz \ {x}) NE = . Clearly V = {Vz}, ¢x is a cover of X, yet 
Y has no finite sub cover. Indeed, for each x € X, V,M E consists of at most one 
point, therefore if A CC X, Uzea Vz can only contain a finite number of points from 
FE, in particular X F Usea Vx. 

(b => c) Let € > 0 be given and choose x; € X. If possible choose xg € X such that 
d(2,%1) > €, then if possible choose x3 € X such that d(x3, {x1,2%2}) > € and con- 
tinue inductively choosing points {2; je c X such that d(a,,, {v1,...,%-1i}) >. 
This process must terminate, for otherwise we could choose E = {2; ae 
infinite number of distinct points such that d(x;,{a1,...,2%;-1}) > e€ for all 
j = 2,3,4,.... Since for all c € X the B,(e/3) A E can contain at most one 
point, no point z € X is an accumulation point of EF. 

(c = a) For sake of contradiction, assume there exists a cover an open cover 
V = {Vahaca of X with no finite subcover. Since X is totally bounded for each 
n € N there exists A, CC X such that 


X= (J B(1/n). 


aeA, 


and 


Choose x; € A, such that no finite subset of V covers Ky := By,,(1). Since K, = 
NweA, h1N Bz (1/2), there exists x2 € Ag such that Ke := K,N B,, (1/2) can not be 
covered by a finite subset of V. Continuing this way inductively, we construct sets 
Kn = Kn-19 Bz, (1/n) with x, € A, such no K;, can be covered by a finite subset 
of V. Now choose y,, € K,, for each n. Since {K,,}°°, is a decreasing sequence of 
closed sets such that diam(K,,) < 2/n, it follows that {y,} is a Cauchy and hence 


convergent sequence and 
y = lim Yn € NP Km. 
n—oco 
Since V is a cover of X, there exists V € V such that x € V. Since K,, | {y} and 


diam(K,) — 0, it now follows that K,, C V for some n large. But this violates the 
assertion that K,, can not be covered by a finite subset of V. m 


Corollary 3.11. Let X be a metric space then X is compact iff all sequences 
{tn} CX have convergent subsequences. 


Proof. If X is compact and {z,} Cc X 


1. If #({t, sn =1,2,...}) < co then choose x € X such that x, = x i.o. let 
{nx} C {n} such that x,, = for all k. Then xp, — x 
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2. If #({a,:n=1,2,...}) = oo. We know EF = {2,} has an accumulation 
point {x}, hence there exists t, — w. 


Conversely if E is an infinite set let {x,}°2, C E be a sequence of distinct 
elements of E. We may, by passing to a subsequence, assume rz, — x € X as 
n — oo. Now x € X is an accumulation point of E by Theorem 3.10 and hence X 
is compact. 

The following is an application of the previous theorem. 


Proposition 3.12. Suppose that (X,p) is a complete separable metric space and 
yu is a probability measure on B = o(tT,). The for all € > 0, there exists K. xX 
such that u(K.) >1—e. 


Proof. Let {x,};2, be a countable dense subset of X. Then X = Ux Bz, (1/n) 
for all n € N. Hence by continuity of jz, there exists, for all n € N, N, < oo such 
that u(F,) > 1—2-" where F, := UN", Bz, (1/n). Let K := 9° F, then 


p(X \ K) = (UR) FS) < So u(F8) = S71 = WF) < hear? =e 


so that (i) > 1—e. Moreover K is compact since K is closed and totally bounded; 
K C F, for all n and each F,, is 1/n — bounded. @ 


3.2. Locally compact spaces. 


Definition 3.13. A topological space X is locally compact if for all « € X there 
exists a compact neighborhood N, of x, ie. Nz X andze N°. 


Remark 3.14. If X is Hausdorff, then X is locally compact iff for every x € X there 
exists V € T, which is precompact. To verify this assertion, suppose that N,, is 
as in Definition 3.13. Let V = N° € 7, then, since N, is closed by Proposition 
3.5, V C Nz and hence V is compact by Proposition 3.4. Conversely if V € Tz is 
precompact, N, = V is a compact neighborhood of x because x € V C N°. 


Finite dimensional Euclidean spaces, R”, are typical examples of locally compact 
spaces. Also any subset of a locally compact space with the relative topology is 
locally compact. 


Proposition 3.15. Suppose X is a locally compact Hausdorff space (LCH for 
short) and U C, X. For all compact subset K of X such that K C U, there exists 
a precompact open set V such that K CV CV CUCX. 


Proof. By local compactness, for all « € K, there exists Uz € Ty such that Uz 
is compact. Since K is compact, there exists A CC K such that {Uz}, ¢, is a cover 
of K. The set O = UzgeaUz is an open set which contains K and is precompact 
since O = UzeaUz — the finite union of compact sets. So by replacing U by UM O 
if necessary, we may assume that U is compact. 

Let Y = U, a compact Hausdorff space and hence a normal space. Since QU 
is closed in X and contained in Y, OU is close in Y.2, Now K and QU are closed 


2Notice that the boundary of U in Y, Oy U, is given by the same as the boundary of U in X 
because 


dyU = UY \U=UNY\U=U\U=WU. 
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disjoint subsets of Y and therefore, there exists disjoint relatively open sets V and 
W in Y such that K C V and OU CW. Since VC Y\WCY, 

V=VnY=V* CY\WcY\U =U, 


wherein we have used V C Y with Y closed in X. Finally V is open in X since 
VcUc, X and V is relatively open in U. (So V =WNU for some W Co X and 
hence V=VNU=WNUC,.X.) @ 


Definition 3.16. Suppose that f : X — C is a function. The support of f, 
supp(f), is the smallest closed set outside of which f is 0, i.e. 


supp(f) ={f #0} =n{C:CCX and fice = 0}. 


Alternatively 
supp(f)° = {f =0}° =U{V:V er and fly =0}. 


If U co X, we will write C.(U) for those function f € C(U) with compact support 
in U. By abuse of notation, we will consider C,(U) as a subspace of C.(X) by 
identifying f € C.(U) with its extension by zero to a function on X. 


For example, let f(x) = sin(a)1)9,4%)(x), then 


{f £0} = (0,47) \ {x, 27, 30} 
and therefore supp(f) = [0, 47]. 


Lemma 3.17 (Locally Compact Version of Urysohn’s Lemma). Let X be a locally 
compact Hausdorff space and K U co X. Then there exists f € C(X, [0,1]) such 
that f = 1 on K and supp(f) U. Alternatively put, if K is compact and C is 
closed in X such that KNC =, then there exists f € C.(X,|0,1]) such that f =1 
on K and f =0 onC. 


Proof. Let V be an precompact open set as in Proposition 3.15, then V is a 
compact Hausdorff space and hence is normal. Since K and OV are closed subsets 
of V, Urysohn’s lemma implies there exists g € C(V,|0,1]) such that g = 1 on 
K and g = 0 on OV. We may now define f = g on V and f = 0 on V,, then 
f € C(X, [0,1]) is the desired function since supp(f) C V and V is compact. m 


Theorem 3.18 (Locally Compact Version Tietze’s Extension Theorem). Let X be 
a locally compact Hausdorff space, K be a compact subset of X and f € C(K,[0,1)). 
Then there exists F € C(X,|0,1]) such that F|x = f. Moreover F may be taken 
to vanish outside a compact set, i.e. supp(F’) is compact. 


Proof. By Proposition 3.15 there exists a precompact open set, V, such that 
KCVCVCX. Let g € C(K UOV) be defined by 


_j f(z) sek 
ate)={ 5 x € OV. 


Then by the Tietze extension theorem, there exists G € C(V,[0, 1]) such that Gn. = 
f and Glav = 0. The desired function F’ € C(X) may now be defined by 


_f G(x) forreV 
Fe)={ 5 ceéV. 


22 BRUCE K. DRIVER 


Definition 3.19. Let X be a topological space. We say that a function f € C(X) 
vanishes at infinity if for all e > 0, {|f] > e} is compact in X. We will denote the 
function f € C(X) vanishing at infinity by Co(X). 


Notice that Co(X) C BC(X). 
Proposition 3.20. Let X be a topological space, BC(X) be the space of bounded 


continuous functions on X with the supremum norm topology. Then 
1. Co(X) is a closed subspace of BC(X). 
2. If we further assume that X is a locally compact Hausdorff space, then 
Co(X) = C-(X). 
Proof. 
1. Suppose that {f,}°°., C Co(X) and f € BC(X) such that || f — fr|| > 0 as 


nm — oo. Since 


we have for all « > 0 that 


provided that n is large enough that || f — f,|| < ¢. Since {|f| > €} is a closed 
subset of a compact set, {|f| > €} is compact as well. Hence f € Co(X). 

2. Since Co(X) is a closed subspace of BC(X) and C.(X) C Co(X), we always 
have C.(X) C Co(X). Now suppose that f € Co(X) and let K, = {|f| > 
+} X. By Lemma 3.17 we may choose ¢,, € C.(X, [0,1]) such that ¢, = 1 
on K,,. Define fy = nf € C.(X). Then 


If — falloo = II(1 = bn) lloo S = + 0.28 1 00. 


This shows that f € C.(X). 
| 
Proposition 3.21 (Alexanderov Compactification). Suppose that X is a non- 
compact Locally compact Hausdorff space. Let X* = X U {oo}, where {oo} is 
a some point disjoint form X. Let 
T=TUL{(X\ K)U{o}: Kk X}. 


The T* is a topology on X* and (X*,T*) is a compact Hausdorff space. Moreover 
if f € C(X) extends to continuously to X* iff f =g+c with g € Co(X) andc eC. 
The extension is given by f(co) =c. 


Proof. Suppose that U,V € 7*. If U or V € 7, then UNV € 7 C 7* and 
U = (X \ K)U {oo} and V = (X \ L)U {oo} where K and L are compact sets then 


UNV =(X\ K)A(X\L)U {oo} = (X\ (KUL)) U foo} er* 


since K UL is compact. Therefore 7* is closed under intersections. Now if U = 
(X \ Kk) U {oo} with k X and V € 7, then 


X*\UUV)=X\((X\K)UV)HXN(KNV)=KAVS 
a compact set and hence 


UUV =(X\(KNV®%))U {oo} € 7%. 
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Similarly if U. = (X \ Ka) U {co} with Ka, X for all a € A, then 
UseAUa = (X \NacaKa) U foo} € r*. 


The other possible cases are now easily checked so the 7* is closed under arbitrary 
unions. Since # and X* are in t* (because () is compact), it follows that 7* is a 
topology. 

Let i: X — X* be the inclusion map. Then 7 is continuous and open, i.e. i(V) is 
open in X™* for all V open in X. If if f € C(X*), then g = f|x—f(oo) = foi—f(c) 
is continuous on X. Moreover, for all € > 0 there exists V € 7%, such that 


\g(x)| = | f(x) — f(oo)| < € for allx € V \ {co}. 


Since V = (X \ K) U {oo}, it follows that g vanishes at oo since {|g| > e} C K. 
Conversely if g € Co(X) extend g to X* by setting g(oo) = 0. Given € > 0, the 
set K = {|g| >} is compact, hence g(X* \ K) C (—e,¢), which shows that g is 
continuous at oo and so g is continuous on X*. Now it f = g+c with c € C and 
g € Co(X), it follows by what we just proved that f extended to X* by f(oo) =c 
is continuous on X*. @ 


Lemma 3.22. Suppose that X is a locally compact Hausdorff space and E Cc X. 
Then E is closed iff EM K is closed for all K XxX. 


Proof. Since compact subsets of Hausdorff spaces are closed, FM K is closed 
if E is closed and K is compact. If E were not closed there exists « € E \ E. By 
Proposition 3.15 there exists a compact set K C X such that x € K® Cc K. I now 
claim that x € KN E. Indeed, if V € tT thn VO KNEDVAK®*NEFO 

since VM K® € t, and a € E. This shows that « ¢ KM E and since x ¢ E we 
see that x € KONE \ (KE). In particular this shows that KN E A KOE and 
hence KM E is not closed. m 


3.3. Partitions of Unity. 


Definition 3.23. Let {Uataea be an open cover of FE Cc X. We say {ha € 
C(X,[0,1])}aea is a partition of unity of F subordinate to {U.} if 
1. supp(ha) C Ug for all a € A, 
2. for all x € X there exists neiguhorneed N, of x such that ha|y, = 0 for all 
but finitely many a. 
3. So he(x) =1 for all x € E. 
a cA 
Proposition 3.24. Suppose that X is a locally compact Hausdorff space, K C X 
is a compact set, and U = {U; et is an open cover of K. Then there exists a 
partition of unity {h; oo of K subordinate to U such that supp(h;) is compact for 
all 7. 


Proof. For all z € K choose V, € 7t,such that V, C U; for some j 


and Vz is compact. Choose A CC K such that K Cc U Vz. Let Fy = 
aren 


U{Vz :@€ Aand Vz C U;}, then F; is compact, F; C U; for all j, and kK C 
Un_,F;. Choose f; € C.(X, [0,1]) such that f; = 1 on Fj and supp (f;) C U;. Then 


9= She) 
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and g > 1 on K and hence K C {g > $}. Choose v € C,(X, [0, 1]) such that v = 1 
on K and supp(v) C {g > $} and define fo = 1—v. Then fo =0 on K, fo =1 if 
g< $ and therefore, 
fot fit---+fn=fot+g>0 

on X. The desired partition of unity may be constructed as 

Fi(z) . 
fo(x) +--+ + fn(x) 
Indeed supp (h;) = supp (f;) C Uj, hj € C-(X, [0,1]) and on K, 

fia cba FE Fite esa 
: fotfiteot+in Ate thn 


hj(x) = 


4. COMPACTNESS IN FUNCTION SPACES 
In this section, let X be a topological space. 
Definition 4.1. Let F c C(X). 


1. F is equicontinuous at « € X iff for all « > 0 there exists U © tT, such that 
f(y) — f(x)| < for all y € U and f € Ff. 

2. F is equicontinuous if F is equicontinuous at all points x € X. 

3. F is pointwise bounded if sup{ f(x) € C|f € F} < oo for alla eX. 


Theorem 4.2 (Ascoli-Arzela Theorem). Let X be a compact Hausdorff space and 
F CO(X). Then F is precompact in C(X) iff F is equicontinuous and point-wise 
bounded. 


Proof. (<=) Since B(X) is a complete metric space, we must show F is totally 
bounded. Let € > 0 be given. By equicontinuity there exists V, € Tx for all 
x € X such that |f(y) — f(x)| < €/2 if y © V, and f € F. Since X is compact 
we may choose A CC X such that X = Uze,V,z. We have now decomposed X 
into “blocks” {Vz},¢, such that each f € F is constant to within € on V,. Since 
sup { f(x): «€ A and f € F} < ov, it is now evident that 


M =sup{f(x):2€X and f € F} <sup{f(x):«e A and fe F}+e<o. 

Let D = {ke/2: k € Z} NM [—M, M] and notice that if f € F and ¢ € DA (ie. 
@: A — Dis a function) is chosen so that |¢(x) — f(x)| < €/2 for all  € A then 
forx«é€ Aandy€ Vy, 


f(y) — P@)1 SIFY) — F@)+1F(@) - o@)| <e. 


A 


2 


Hence if we set, for ¢ € 
Fy ={f © F:|fly) — 0(x)| < for y € Vz and x € A} 
then F =U {F,:¢€ DA 


Let [ := {pe A. Fo # 0} and for each ¢ € I choose fy € FyNF. For f € Fo, 
x € A and y € V, we have 


f(y) — fo) SIF) — O(2))| + 10(@) — fo(y)| < 2€. 
So || f — fg|| < 2e for all f € Fy showing that Fy C B;,(2e). Therefore, 
F = Uper Fo C Uger By, (2e) 


MATH 240B LECTURE NOTES: TOPOLOGY AND FUNCTIONAL ANALYSIS 25 


and because € > 0 was arbitrary we have shown that F is totally bounded. 

(=) Since ||-|| : C(X) — [0, 00) is a continuous function on C(X) it is bounded 
on any compact subset F C C(X). This shows that sup {|| f]| : f € F} < oo which 
clearly implies that F is pointwise bounded.? Suppose F were not equicontinuous 
at some point « € X that is to say there exists « > 0 such that for all V € 
Tz, sup sup | f(y) — f(x)| > €.4 Equivalently put, to each V € T, we may choose 

yEV fEF 
(4.1) fv €F and zy € V such that |fy(x) — fv(av)| > 2 


Set Cy ={fw:Werm andWc yes 


AvevCy 2 Cry £9, 


so that {Cv }\ € T: C F has the finite intersection property. Since F is compact, 
it follows that there exists some 


C F and notice for any V CC T, that 


fe (|) cv #0. 


VET. 
Since f is continuous, there exists V € 7, such that | f(x) — f(y)| < €/3 for all 
y € V. Since f € Cy, there exists W Cc V such that || f — fw|| < €/3. We now arrive 
at a contradiction since 
€< |fw(2) — fw(ew)| < fw (@) — F(@)| + [Ff (2) — flew)| + |flew) — fw (ew) 
<¢/8+6¢/3+6/3 =€ 


which is a contradiction. 


Definition 4.3. A topological space (X,T) is said to be o — compact if there 
exists compact set K,, C X such that X = U7?) K,,. Notice that we may assume, 
by replacing K,, by K, U Ko U---UK,, if necessary, that K, t X. 


Lemma 4.4. Suppose X is a a-compact and locally compact Hausdorff space. Then 
there exists precompact open set S, C X such that S, C Sp C Sr41 for all n. 


Proof. Choose K,, | X as in Definition 4.3. Let Uy C 7 be a finite cover of Ky 
by precompact open sets. Take S$; = Ul/,. Then S; is open and precompact. We 
may now inductively construct S, as in the lemma with the added property that 
Ky C Sp. Indeed if $1,..., 5, have been chosen as described such that K; C S; for 
alli = 1,2,...,n, then let U,,41 a finite cover of K;, US, by precompact open sets 
and define S,41 = UWUn41. © 


Corollary 4.5. Let {f,} C C(X) be a pointwise bounded sequence of functions 
which is equicontinuous on compact subsets of X. Then there exists a subsequence 


3One could also prove that F is pointwise bounded by considering the continuous evaluation 
maps eg : C(X) — R given by ex (f) = f(x) for all « € X. 

4If X is first countable we could finish the proof with the following argument. Let {V;, eer 
be a neighborhood base at z such that Vi D V2 D V3 D.... By the assumption that F is not 
equicontinuous at «, there exist fr € F and an € Vy such that |fn(x) — fn(an)| > € Vn. Since 
F is a compact metric space by passing to a subsequence if necessary we may assume that fn 
converges uniformly to some f € F. Because zn — & as n — oo we learn that 


€< |fn (x) — fn(@n)| < |fn(@) — f(x)| + |f(e) — f(a@n)| + If (en) — fn(en)| 
<2\|fn — fil +1f(@) — f(e@n)| — 0 as n > 00 


which is a contradiction. 
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{np} C {n} such that g, := fn, 18 @ sequence which is convergent uniformly on 
compact subsets of X. 


Proof. Let K,,’s be compact subsets of X and use Proposition 3.15 to find 
precompact open sets V,, containing K,,. So by replacing K,, by Vp if necessary, we 
may find compact sets K,, such that X = US, K®. 

We may now apply Theorem 4.2 repeatedly to find a nested family of subse- 
quences 


Wnt > (Gah Soe) AG oe 
such that { aes is a sequence of continuous functions uniformly convergent on 
Ky. Using Cantor’s trick, define the subsequence {hx} of {fn} by hy = gf. Then 
{h,} is uniformly convergent on each K,,. Now if K Cc X is an arbitrary compact 
set, there exists M < oo such that K cC U"_, K® c UM, K,, and therefore {h;,} is 
uniformly convergent on K as well. m 


CO 


Theorem 4.6 (Peano’s Existence Theorem). Suppose f : R x R¢ > R®¢@ is a 
bounded continuous function. Then there exists a solution to the differential equa- 
tion 
x(t) = f(t, x(£)) fort > 0 with 
x(0) = 20. 
Proof. Given ¢ > 0, there exists a unique function x, € C([—€, co) — R*) such 
that x,.(t) = x for -e<t< 0 and 


(4.2) X(t) = 29 + : f(t, ae(7 — €))dr for all t > 0. 
0 


Indeed if t € [0,¢], define x(t) by Eq. (4.2), then use Eq. (4.2) to define x, on 
[e, 2e], etc. Let M = sup |f(t,x)| < oo, then 


t 
|ze(t)| < |zo| +f |f(7, te(7 — €))| dr < |xo| + Mt 
0 
and 


t 
|x-(t) — xe(s)| = if f(t, ve(7 — €))dr| < Mt — | 

for allt > s > 0 and € > O. Therefore {z,}.s9 is an equicontinuous pointwise 
bounded family in C({0,0o), IR“) and hence there exists ¢€, | 0 such that x, uni- 
formly converges on compact subintervals of [0,0o).to some x € C((0,00), R®). 


Passing to the limit in Eq. (4.2) implies that 


x(t) = lim 2,,(t) = x0 +f f(t, a(7))dr. 


k—oo 
| 
We could give another proof of this theorem as follows. Let f.(t,-) = f(t,-) * 6 
where 6, is an approximate 6 — function as described in Lemma 5.2 and 5.3 below. 
Then let x(t) solve 
&-(t) = f(t, x-(t)) for t > 0 with 


x-(0) = 29 
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which we know has solutions by the Lipschitz case proved on the homework. More- 
over {Xe}..9 has uniformly bounded derivatives and hence are equicontinuous. 
They are also pointwise bounded, so there exists «, | 0 such that 2,, uniformly 
converges on compact subintervals of R to some x € C(R, R*). Passing to the limit 
in the integral equation 


wre, (t) = 20 + i fey (Te, (7))ar 


then shows that x solves the desired ordinary differential equation. 


5. APPROXIMATION THEOREMS 
5.1. Classical Weierstrass Approximation Theorem. 


Theorem 5.1 (Weierstrass Approximation Theorem). Let f € C({a,b],R), then 
there exists polynomials P,,(x) such that P, — f uniformly. 


We will give the proof after the next two lemmas. For this lemma let {Q,}>° 
be the following sequence of “approximate 6 — functions:” 


n=1 


1 1 
(5.1) Qn(x) = rae _ aw)" Volct where Cy := : (1 — a?)"dz. 


n -1 


We will give two proof of this theorem. The first is based on approximate 6 — 
functions and the second is based on the weak law of large numbers. 


Lemma 5.2. Let {Qn}°_, be the sequence of functions defined in Eq. (5.1), then 
ie dx = [ Qn(w) dx = 1 
R -1 


lim / Qn(a)dx = 0. 


n—0o 
|a| De 


and for any « >0 


Proof. The first assertion is obvious from the definition of c,,. For the second 
we have (using symmetry) 


= 2 f- (1—2")"dx 
= oe 2 {5 (1 — 2?)"de + ae — x2)\"dxr 
wf 30s Pre (ee 


s < [20 —@rde 2 —a2)nde  (1—22)"*1¢ 


(1 @yp4 
— 1-2 >Oasn— oo. 
2 ‘a — x7)"dx 
|2|>« 2 [be a) da 2 [= 2) rdae 


je Gleaner) "dx me kee (1 — x?)"dx 
‘1 —22\"da = oa 
Te x) de 
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Combining this equation with 


1 —(] — 72)r41 1 — e2)\(r1) 
fa-2re- ee *) [nen cee at eo) 


2(n + 1) 2(n +1) 
shows that 
(i= e2)(n+1) (1-2) 
dz < a . 
ios Qn(a)de (1—€2)"e22(n +1) €2(n+1) >O0 as n— 00 
| 


Lemma 5.3. Suppose that {Qn} >, is a sequence of positive functions on R such 
that 


(5.2) [enw dx = 1 and 


(5.3) lim Qn(a)dx = 0 


n—0o 
|x| De 


for alle > 0. For f € BC(R), let 


On * fla one dy = [ Qnlu) fle a)dy 
Then Qn x* f converges to f uniformly on compact subsets of R. 


Proof. Let x € R, then because of Eq. (5.2), 
Qn + He) = FeO =| f Qala) fle = 9) = Feo as} < f Qntw) [Fee —w) ~ FC] a 
R 
Let M = sup {|f(x)| : 2 € R} and € > 0, then by and Eq. (5.2) 


IQn * f(x) — f(@)| < Qn(y) |F(@ — y) — F(a)| dy 


ly|<e 

+ : Qn(y) |F(@ — 9) — F(a)| dy 
Yl >eE 

=e |f(@ +z) — f(w)|+2M f Qn(y)dy 
Z| SE y|>eE 


Let K be a compact subset of R, then 
sup |Qn * f(x) — f(x)|< sup |f(w@+z)— f(x)|+2M Qn(y)dy 
aek jz|\<e,2ek ly|>e 


and hence by Eq. (5.3), 
lim sup sup |Qn * f(x) — f(z)|< sup [f(a +z) — f(x)|. 


noo xe K jel|<e,zeEK 


This finishes the proof since the right member of this equation tends to 0 as € | 0 
by uniform continuity. 
Proof. (Weierstrass Approximation Theorem) We begin with two reductions: 
1. We may reduce the problem to the case where a = 0 and b = 1 by considering 
the function 


g(x) = f(a+2(b—a)) for x € [0,1]. 
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2. Moreover, by considering the function go(x) = g(x) — g(0) — x(g(1) — g(0)) 

we may assume that f € C((0,1],R) and f(0) = f(1) =0. 

So suppose that f € C([0,1],R) and f(0) = f(1) = 0 and that f has been 
extended to all R by setting f = 0 on R\(0, 1]. Let Q,,(x) be defined as in Eq. (5.1). 
Then by Lemma 5.2 and 5.3, p(x) := (Qn * f)(x) — f(x) uniformly for x € [0,1] 
as n — oo. So to finish the proof it only remains to show p,(«) is a polynomial 
when x € [0,1]. This follows for x € [0, 1] since 


(l-(a-y = Yoel 


where a;(y) are polynomials in y and therefore 


os, C4 )F(udy = — | f(y)(1 — (@ — 9)?)"1e_-ycady 
= Fu \(1 = (a — y)2)"ady 


Cn 


LE (somo) 2 


Proof. (The second proof of the Weierstrass Approximation Theorem) As in 
the first proof it suffices to assume that f € C((0,1]). For « € [0,1] let yz be the 
measure on {0,1} given by pie ({O}) = 1— x and pz ({1}) = x. For n € N and 
x € {0, 1], let uw” denote the n — fold product of yz, with itself on Q, := {0,1}” and 
let X;(w) = w; for w € {0,1}”. We also let S,, = (X; + Xp +---+X,,)/n. The law 
of large numbers then states that S,, should be close to 


: Xian = | wdfiz(w) =1-2+0-(l-z)=2 
QR {0,1} 


when n is large Let us define 


n= ff rSyqe= Os (S4R EF) Tea ay. 
i=1 


wEQn 


The later shows that p,(a) is a polynomial in x of degree at most n. By the law 
of large numbers we expect that p,(x) is close to f(x), a fact which we will now 
verify. Let ¢ > 0 be given, then since uw? (Q,,) = 1, 


Foarel= 1 (f(x) — f(Sn)) aye2| < i LF) — f(Sn)| du 


< ; LF(@) — F(Sn)| dp + | If(0) — f(Sn)| a2 
{|S;,—2|>e} {|Sn —a|<e} 
< 2M py (Sn a x| > €) 


+ sup {|f(y) — f(@)| + y € [0,1] and |y — 2 < e} 
(5.4) < 2M yr (|S, — 2] > 6) + 6 


where M = sup {|f(x)|: x € [0, 1]} and 
6. = sup {|f(y) — f(x)|: x,y € [0,1] and jy —2| <e}. 
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By uniform continuity, 6, — 0 as e — 0 and by Chebyshev’s inequality, 


1 1 1 

Mz (Sn 2] >) Sa [ (Sn—2)*dur=a fl (— >) (Xe—2))Pdue 
& Jo 4 Jo on 

n n k=1 


n 


= saa | Yo Ke 2K — ahd. 


egal 


By Fubini’s theorem, it follows that for k #7 that 


2 
) oe 90as— ant =| f wana) =0 
Qn {0,1} 


and 
[ (Xp — «)Pdut = i: (w — 2)? dite (w) = (1—2)?2 + 2°(1—2) <2. 
Qn {0,1} 
Combining the last three displayed equations shows that 
. 1 2 
My (1Sn = 2| > €) s nae” = nee 


which combined with Eq. (5.4) implies that 
4M 
sup |f(x) — pn(x)| < —> +6, 
S| (x) — Pn(#)|S ~ 3 
and therefore 


lim sup sup |f(x) —pn(x)| <6. ~O0ase—0. 
WEF w€([0,1 
7 


5.2. The Stone-Weierstrass Theorem. We now wish to generalize Theorem 5.1 
to more general topological spaces. We will first need some definitions. 


Definition 5.4. Let X be a topological space and A Cc C(X) = C(X,R) or 
C(X,C) be a collection of functions. Then 


1. A is said to separate points if for all distinct points x,y € X there exists 
f € Asuch that f(x) 4 f(y). 

2. A is an algebra if A is a vector subspace of C(X) which is closed under 
pointwise multiplication. 

3. A is called a lattice if f V g := max(f,g) and f A g = min(f,g) € A for all 
fgEA. 

4. AC C(X) is closed under conjugation if f € A whenever f € A® 


Remark 5.5. If X is a topological space such that C(X,R) separates points then 
X is Hausdorff. Indeed if x,y € X and f € C(X,R) such that f(x) F f(y), then 
f-'(J) and f71(J) are disjoint open sets containing x and y respectively when I 
and J are disjoint intervals containing f(x) and f(y) respectively. 


Lemma 5.6. If AC C(X,R) is a closed algebra then |f| € A for all f ¢ A and A 
is a lattice. 


®This is of course no restriction when C(X) = C(X, R). 
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Proof. Let f € A and let M = sup|f(x)|. Using Theorem 5.1, there are 
wEeX 
polynomials P,,(t) such that 


lim sup ||¢| — P,(t)| = 0. 


By replacing P,, by P,, — P,,(0) if necessary we may assume that P,,(0) = 0. Sine 
A is an algebra, it follows that f, = P,(f) € A and |f| € A, |f| being the uniform 
limit of the f,,’s. This also shows that A is a lattice since 


~(fta+lf—al) 
egal sel. 


fVg= 


fAg= 


Nl re b| 


Lemma 5.7. Let A Cc C(X,R) be an algebra which separates points and x,y € X 
be distinct points such that 


(5.5) df,g¢€A such that f(x) £0 and g(y) £0. 
Then 
(5.6) V = {(F(2), f(y): fe AJ= RY. 


Proof. It is clear that V is a non-zero subspace of R? If dim(V) = 1, then 
V = span(a, b) with a 4 0 and b 4 0 by the assumption in Eq. (5.5). Since (a,b) = 
(f(x), f(y)) for some f € Aand f? € A, it follows that (a?,b?) = (f?(zx), f?(y)) EV 
as well. Since dim V = 1, (a,b) and (a?, b?) are linearly dependent and therefore 


2 
o=aet( § yp ) —al? bn? = ab(b— a) 


which implies that a = b. But this the implies that f(x) = f(y) for all f € A, 
violating the assumption that A separates points. Therefore we conclude that 
dim(V) = 2, i.e. that V = R?. m 


Theorem 5.8 (Stone-Weierstrass Theorem). Suppose X is a compact Hausdorff 
space. A C C(X,R) is a closed subalgebra which separates points and for x © X 
let 

Ax = {f(x): f © A} and 

Tz ={f € C(X,R) : f(x) = 0}. 
Then either one of the following two cases hold. 


1. A, = R for all ax € X, i.e. for all x € X there exists f € A such that 


fa) £0." 
2. There exists a unique point x € X such that A, = {0}. 


Moreover in case (1) A = C(X,R) and in case (2) A=Tz, = {f € C(X,R): 
f(x) = OF. 

Proof. If there exists zp such that Az, = {0} (xo is unique since A separates 
points) then A,, C Z,,. If such an 29 exists let C = T,, and if A, = R for all 2, 


“If A contains the constant function 1, then this hypothesis holds. 
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set C = C(X,R). Let f € C, then by Lemma 5.7, for all x,y € X such that « 4 y 
there exists gx € A such that f = gx, on {z,y}3 


Claim 5.9. Given « > 0 and x € X there exists g, € A such that g,(x) = f(x) 
and f <gz +¢€ on X. 


To prove the claim, let V, be an open neighborhood of y such that |f — gay| < € 
on V, so in particular f < €+ gz, on V,. By compactness, there exists A CC X 


such that X = [J Vy. Set 
yer 


Gu (Z) = max{guy(z) sy € A}, 
then for any y € A, f <€+ Gry < €+ 9, on V, and therefore f < ¢€+g, on X. 
Moreover, by construction f(x) = gx(x). 

We now will finish the proof of the theorem. For each x € X, let U, bea 
neighborhood of x such that |f — gz| < € on Uz. Choose Tf Cc X such that 
X = U U, and define 

«eT 
g=min{g,: «cET}eA. 


Then f <g+eon X and for 2 €T, gz < f +¢€ on Uz and hence g < f +€ on Ug. 
Since X = [J U,, we conclude that 
«cel 
f<gteandg<fteonX, 
ie. that |f — g| < on X. Since € > 0 is arbitrary it follows that f¢ A= A. @ 


Theorem 5.10 (Complex Stone-Weierstrass Theorem). Let X be a compact Haus- 
dorff space. Suppose A C C(X,C) is closed in the uniform topology, separates 
points, and is closed under conjugation. Then either A = C(X) or A=T,,, for 
some Xp € X. 


Proof. Since 
fat 
2” 


SY 
ah 
SI 


Re f = 
Re f and Im f are both in A.Therefore 
Ap = {Re f,Imf: f € A} 


is a real sub-algebra of C(X,R) which separates points. Therefore either Ap = 
C(X,R) or Ag = Tx, A C(X,R) for some x and hence A = C(X,C) or Tz, 
respectively. 


and Imf = 


Example 5.11. Let X = $1 = {z © C: |z| =1} and A be the set of polynomials 
in z and Z, ie. A is the algebra generated by {1, z,z}. Then A separates points, 
1 € A and J is closed under conjugation allows us to conclude from Theorem 5.10 


that A = C(X). 
Corollary 5.12. Given a continuous function f :R — C which is 2m -periodic and 


€ > 0 there exists p(0) = > ane”? such that |f(@)— P(0)| < € for allO ER. 
N 


n=— 


If we are in the case whrere Az, = {0} and x = Zo or y= Zo, then gay exists merely by the 
fact that A separates points. 
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Theorem 5.13. Let X be non-compact locally compact Hausdorff space, space. If 
A is a closed subalgebra of Co(X,R) which separates points. Then either A = 
Co(X,R) or there exists x9 € X such that A= {f € Co(X,R): f(xo) = O}. 


Proof. If there exists x9 € X such Ac {f € Co(X,R) : f(ao) = 0} let X* 
be the one point compactification of X \ {xo} otherwise let X* be the one point 
compactification of X. Now apply Theorem 5.8 to learn that A Cc C(X*,R) is 
A =To = Co(X* \ {co} ,R). = 
Example 5.14. Let X = [0,00), \ > 0 be fixed, A be the algebra generate by 
t > e~. So the general element f € A is of the form f(t) = p(e~*’), where p(z) 
is a polynomial. Since A C Co(X,R) separates points and is pointwise positive, 
A = Co(X,R). 

As an application of this example, we will shows that the Laplace transform is 
injective. 


Theorem 5.15. For f € L'({0,0o),dz), let the Laplace transform is defined by 
LFA) = | e >” f(x)dx for all \ > 0. 
0 


If LF(A) =0 then f(x) =0 for m -a.e. x. 


Proof. Suppose that f € L'((0,00c),dx) such that Lf(A) = 0. Let g € 
Co({0,0o),R) and « > 0 be given. Choose {a,},s0 such that {A >0:a, 4 0} 
is a finite set and 


\g(x) — x aye—**| < for all « > 0. 


dA>0 
Then 
ee x)dx| = a x) — aye? x)dx 
[ s@rea i (v0 va ) foo 
o x)— axe x)| dx 
< [fale ae li) 4 


< ellflla- 


Since € > 0 is arbitrary, it follows that [>° g(a) f(x)dx = 0 for all g € Co([0, 00), R). 
Let 


0 if f(z) =0 


and define du(x) = |f(x)|dm(x). Then w is a measure on [0,0o) such that 
u([0,0co)) < co. By our regularity theorems, we know that C,([0,co)) is dense 
in L'(). Therefore there exists gn, € C.({0,0o)) such that g, > sgnf in L'(). 
Therefore, 


o= [ 9n(x)f (x) dx 
J / gn (t)sen f(@)du(r) "2° | Isgn f(oe)[2du(e) = | If («)|am(c). 


senf (x) = He] if f(x) #0 
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6. PRODUCT SPACES AND TYCHONOFF’S THEOREM 


6.1. Product Spaces. Let {(Xa,T)}qe,4 be a collection of topological spaces (we 


assume X_ #{)) and let X4 = || Xa. Recall that x € X,y is a function 
acA 


r:A7 II Xo 
acA 
such that tq := x(a) € Xq for all a € A. An element x € Xy is called a choice 
function and the axiom of choice states that X4 4 # provided that Xq 4 # for 


each a € A. If each Xq above is the same set X, we will denote X4 = |] Xq by 
acA 
X4. So x € X4 is a function from A to X. 


Notation 6.1. For a € A, let mt, : X4 — Xq be the canonical projection map, 
Ta(x) = 2q. The product topology 7 = ®acaTo is the smallest topology on X4 
such that each projection 7 is continuous. Explicitly, 7 is the topology generated 
by 


(6.1) E={nz'(Va): a@€ A, Ve € Ta}. 
A “basic” open set in this topology is of the form 
(6.2) V={x € X4: T(x) € Va for a€ A} 


where A is a finite subset of A and Vq € Tg for all a € A. We will sometimes write 
V above as 


V = [] Vax [] Xa = Va x Xaya. 
acA agA 


Proposition 6.2. Suppose Y is a topological space and f : Y > X,4 is a map. 
Then f is continuous iff Tyo ff: Y 3 Xq is continuous for all a € A. 


Proof. If f is continuous then 7, 0 f is the composition of two continuous 
functions and hence is continuous. Conversely if 7, 0 f is continuous for all a € A, 
the (tT 0 f)~'(Va.) = f-1 (751 (Va)) is open in Y for alla € A and V, Cy Xq. That 
is to say, f—'(E) consists of open sets, and therefore f is continuous since € is a 


subbase for the product topology. ™ 


Proposition 6.3. Suppose that (X,T) is a topological space and {f,} C X4 is a 
sequence. Then fn — f in the product topology of X4 iff fn(a) — f(a) for all 
aca. 


Proof. Since 7, is continuous, if f, — f then f,(a) =7a(fn) - Tal(f) = f(a) 
for all a € A. Conversely, fn(a) — f(a) for all a € A iff ta(fn)  Ta(f) for all 
a € A. Therefore if V = 77'(Va) € € and f € V, then ma(f) € Vo and 7a(fn) € Va 
a.a and hence f, € V a.a. This shows that f, — f asn— oo. 


Proposition 6.4. Let (Xq,T.) be topological spaces and X4 be the product space 
with the product topology. 


1. If Xq is Hausdorff for all a € A, then so is X 4. 
2. If each Xq is connected for all a € A, then so is Xa. 


Proof. 
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1. Let x,y € X 4 be distinct points. Then there exists a € A such that 7a (x) = 
La # Ya = Taly). Since Xq is Hausdorff, there exists disjoint open sets 
U,V Cc Xq such m7,(x) € U and ma(y) € V. Then 7Z'(U) and 7Z1(V) are 
disjoint open sets in X4 containing x and y respectively. 

2. Let us begin with the case of two factors, namely assume that X and Y are 
connected topological spaces, then we will show that X x Y is connected 
as well. To do this let p = (x9,yo) € X x Y and E denote the connected 
component of p. Since {xo} x Y is homeomorphic to Y, {xo} x Y is connected 
in X x Y and therefore {1} x Y C E,ie. (v0, y) € E for all y € Y. A similar 
argument now shows that X x {y} C E for any y € Y, that isto X x Y= E. 
By induction the theorem holds whenever A is a finite set. 

For the general case, again choose a point p € X, = X4 and let C = C, be 
the connected component of p in X 4. Recall that C, is closed and therefore 
if Cy is a proper subset of X 4, then X 4 \ Cy, is a non-empty open set. By the 
definition of the product topology, this would imply that X4 \C, contains an 
open set of the form 


V = Maea™ (Vo)= Vax XA\a 


where A CC A and Vy € Ta for all a € A. We will now show that no such V 
can exist and hence X4 = Cy, i.e. X 4 is connected. 
Define ¢: X, — X,4 by ¢(y) = x where 


Ifae A, ta°O(Y) = Ya = Tally) and if a € A\ A then 7,0 ¢(y) = pa so that 
in every case 7g 06: Xq — Xgq, is continuous and therefore ¢ is continuous. 

Since X, is a product of a finite number of connected spaces it is con- 
nected by step 1. above. Hence so is the continuous image, (Xa) = 
Xa X {Pataea\as of Xa. Now p € $(Xq) and ¢(Xq) is connected implies 
that ¢(X,) C C. On the other hand one easily sees that 


PAVIG(Xa) CVC 
contradicting the assumption that V C C°. 
| 


6.2. Tychonoff’s Theorem. The main theorem of this subsection is that the 
product of compact spaces is compact. 


Theorem 6.5 (Tychonoff’s Theorem). Let {Xa}aca be a collection of non-empty 
compact spaces. Then X4 = [|] Xq is compact in the product space topology. 
acA 
The proof of this theorem requires Zorn’s lemma which is equivalent to the axiom 
of choice, (see Theorem 8.7 below). Before going into the details of the proof, let 
us first prove the following special case. 


Proposition 6.6. Suppose that X and Y are non-empty compact topological 
spaces, then X x Y is compact in the product topology. 


Proof. Let U/ be an open cover of X x Y. Then for each (z,y) © X x Y 
there exist U € U such that (x,y) € U. By definition of the product topology, 
there also exist V, € 78 and W, € 7 such that Vz x Wy C U. Therefore V := 
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{Vx X W, : (2, y) € X x Y} is also an open cover of X x Y. We will now show that 
Y has a finite sub-cover, say Vo CC VY. Assuming this is proved for the moment, 
this implies that U/ also has a finite subcover because each V € Vo is contained in 
some Uy €U. So to complete the proof it suffices to show that every cover V of the 
form Y = {Va x Wa: a € A} where V, Co X and W, Co Y has a finite subcover. 

Given x € X, let f, : Y — X x Y be the map f,(y) = (x,y) and notice that 
fe is continuous since tx © f,(y) = « and my o f(y) = y are continuous maps. 
From this we conclude that {x} x Y = f,(Y) is compact. Similarly, it follows that 
X x {y} is compact for all y € Y. 

Since VY is a cover of {x} x Y, there exist [, CC A such that {a} x Y C 


U (Va x W..) without loss of generality we may assume that T, is chosen so that 
acl, 
x € Vq for alla €T,. Let Uz = (| Va Co X. Then {Uz},- x is an open cover of 
acer, 
X which is compact, hence there exists A CC X such that X = Uze,U,. The proof 


is completed by showing that Vo := Urea Uaer, {Va X Wo} is a cover of X x Y, 
UVo = Urea Unser, (Va X Wa) D Urea Uaer, (Ux x Wa) = Urea (Ux x Y) =X XY. 


a 
The next lemma is the crux of the proof of the general case of Theorem 6.5. 


Lemma 6.7 (Alexander’s Lemma). Let (X,7) be a topological space. Let E C T be 
a subbase for the topology of T, T = T(E). Then X is compact iff every open cover 
BCE of X has a finite subcover: 


Proof. It is clear that if X is compact and B C € is a cover of X, then B has a 
finite subcover. So it suffices to show that if X is not compact, there exists a cover 
BC € with not finite subcover. We will construct B in two steps. 


1. There is a maximal open cover A of X with no finite subcover. Let U/ be the 
collection of open covers of X with no finite subcovers and partially ordered U/ 
by inclusion. (U/ is not empty by definition since X is not compact.) Suppose 
that {As}gep C U is a linearly ordered collection. Then if U;,...,Un € 


U Ag, by linear order of {Ag}gep, there exists 69 € B such that U),...U, € 
BEB 
Ag, for some § € B. Since Ag, € U is an open cover of X with no finite 


subcover, it follows that J) U; # X and hence |) Ag is a cover of X with 


i=1 BEB 
no finite subcover. Hence J) Ag € U is an upper bound for {Ag}ges, so we 
BEB 


may apply Zorn’s Lemma to conclude that U/ has a maximal element which 
we denote by A. 

2. We will finish that proof by showing that B = AM € is a cover of X. (Notice 
that 6 can not have a finite subcover, since if it did A would also have finite 
subcover.) For sake of contradiction, suppose that there exists x € X \ UB. 
Since A covers X there exists U € A such that « € U and because 7 = T(E), 
there exists V,,...,Vpn € € such that 


rEVLN-:-AV, CU. 


Notice that no V; is in A, for if one were (say V;), we would have V; € B and 
hence x € UB. Because A is maximal, AU {V;} must have a finite subcover 
for each j. Hence for each j = 1,2,...,n there exists A; CC A such that if 
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W, = UA; then V; UW; = X. Now 
UU| JW; 2 (Nw) U (Um) = 
1 1 1 
which implies that A’ := {U}U U?_, A; is a finite subcover of A.° This is a 
contraction to the fact that A had no finite subcover and hence UB = X. 
rT] 
We now give the proof of Tychonoff’s Theorem. 
Proof. (Tychonoff’s Theorem) By Alexander’s Lemma 6.7, we must shows that 


every open cover V, which is contained in the subbase € = {m7 1(U): U Co Xa, A € 
A}, has a finite subcover. If V is such an open cover and a € A, let 


Va ={U Co Xa tz (VU) EV}. 


Claim: There exists some ( € A such that Vg is a cover of Xg. 
If there were no such 3, then Vg := UVg & X@ for all 8 € A. So by the Axiom 
of choice there would exists some x € [[,<4 (Xe \ Va). On the other hand 


Ve bas Val= (tm, Oe O'S Vad 


acA acA 


and x € UY (¥V is a cover of X 4), so there must exist some @ € A and Ug € Vg 
such that 7g(a#) € Ug. But this is precluded by choice of x € [|< 4 (Xe \ Va). This 
proves the claim. 
Let 6 € A such that Vg is a cover of Xg. Using the compactness of Xg, there 
exists {U;}"_, C Vg (n < 00) such that {U;}"_, covers Xg. Then {n3'(ui)} on 
i=l 


is now the desired subcover of X 4. 


7. URYSOHN’S METRIZATION THEOREM 


Definition 7.1. Let J = [0,1] and A be a non-empty set, then 4 with the product 
topology is called a cube. 


Definition 7.2. Let X be a topological space. A subset F C C(X, I) is said to 
separates points and closed sets if for all x € X and closed sets F C X such 


that « ¢ F, there exists f € F such that f(x) ¢ f(F). 


Remark 7.3. If f is as in Definition 7.2, we may find h € C(J,I) such that h = 0 
on f(F) and h(f(x)) =1. Then g = ho f € C(X, J) has the property that g(x) = 1 
and g(F) = {0}. 

Notation 7.4. Given F c C(X,1), define e: X — I* by x — e, where e,(f) = 
f(x). The function e, € I* is called the evaluation map at x € X. 


Proposition 7.5. Let X be a topological space and F Cc C(X,I). Then 


1. The map e: X — I? is continuous. 
2. If F separates points then e is injective. 


fe n nm 
®Let X = (() V3) U(UW;) and notice that for alla € X =V; UWj, x € V; or « € W;. Hence 
1 1 
if « € UW; then « € X and if « ¢ PW; then a € V; for all j ie. & € NV; which again shows 
j j 


that 2 € X. That is to say X C X and hence X = X. 
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3. If F separates points and closed sets; then e is a homeomorphism onto its 
range. 

Proof. (1) For f € F, let 7» : I7 — I be the projection map, 7/(z) = 2(f). 

Then 
m0 e(x) = Te(€x) = ex (f) = f(z) 

which shows that 7¢oe = f is continuous for all f € ¥ and therefore e is continuous. 

(2) Since e, = e, iff f(x) = ex (f) = ey(f) = f(y) for all f € F, e is injective iff 
F separates points. 

(3)We must show that e is an open map, ie. if U Co X then e(U) is open in 
e(X) in the relative topology. Let U Co X and x € U. Since x ¢ U* there exists 
f © F such that f(x) ¢ f(U*%). Let 


V=nz (FU) = {2 €I7 sf) E FU} CI. 


Then 


Vin e(X) = fey: f(y) € FU} 
is a relatively open subset of e(X) and by construction x € VM e(X). We will now 
finish the proof by showing VMe(X) C e(U). This will be accomplished by showing 
ify ¢ U then e, ¢ V. Now if y € U*, then e,(f) = f(y) € f(US) C f(U*) and 
therefore e, ¢ V. ™ 


Theorem 7.6 (Urysohn Metrization Theorem). Every second countable normal 
space X is metrizable. Moreover, there is a metric S compatible with the topol- 
ogy such that X is totally bounded and hence the completion of X is compact. 


Proof. The proof of the theorem will be broken into four steps. 


1. By Folland problem # 4.76 there exists a countable subset F C C(X, [0, 1]) such 
that for allz € X and EC X there exists f € F such that f(x) = 1 and 

2. By Folland problem # 4.77 the product topology and Y = [0,1]* is metriz- 
able. Let d be a metric on Y compatible with the product topology. 

3. For x € X, let e, : X — Y be defined by e,(f) = f(x). Then by Proposition 
7.5 the map e: X — Y define by x — e, is a homeomorphism onto e(Y) = 
{e,:«€F} CY when e(Y) is equipped with the relative topology from Y. 

4. Define p(x, y) = d(ez, ey), then since e : X — e(X) C Y is a homeomorphism, 
p is a metric on e(X) compatible with the topology on X. By Tychonoff’s 


——d 
Theorem, Y is compact and therefore the closure e(X) , of e(X) in Y is 
compact as well. Since the completion, x of X is homeomorphic to the 


e(X) we conclude that X°” is compact and hence totally bounded. It now 
easily follows that X is totally bounded as well. 


8. ZORN’S LEMMA AND THE HAUSDORFF MAXIMAL PRINCIPLE 


Definition 8.1. A partial order < on X is a relation with following properties 
(i) Ifa<yandy<zthenaz< z. 
(ii) Ife<yandy<vzthenz=y. 

(iii) «<a forallae X. 
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Example 8.2. Let Y be aset and X = P(Y). There are two natural partial orders 
on X. 


1. Ordered by inclusion, A < B is AC B and 
2. Ordered by reverse inclusion, A< Bif BC A. 


Definition 8.3. Let (X,<) be a partially ordered set we say X is linearly a 
totally ordered if for all x,y € X either x < y or y < x. The real numbers R with 
the usual order < is a typical example. 


Definition 8.4. Let (X,<) be a partial ordered set. We say « € X is a maximal 
element if for all y € X such that y > x implies y = 2, i.e. there is no element 
larger than x. An upper bound for a subset FE of X is an element x € X such 
that x > y for all y € E. 


Example 8.5. Let 
At a1} b= {1,2} c={3} d= {2,4} e = {2} } 


ordered by set inclusion. Then b and d are maximal elements despite that fact that 
bf£aanda <b. We also have 


e If F = {a,e,c}, then E has no upper bound. 


Definition 8.6. e If F = {a,e}, then b is an upper bound. 
e EF = {e}, then b and d are upper bounds. 


Theorem 8.7. The following are equivalent. 


1. The axiom of choice. 

2. The Hausdorff Maximal Principle: Every partially ordered set has a 
maximal (relative to the inclusion order) linearly ordered subset. 

3. Zorn’s Lemma: If X is partially ordered set such that every linearly ordered 
subset of X has an upper bound, then X has a maximal element.!° 


Proof. (2 => 3) Let X be a partially ordered subset as in 3 and let F = {EC 
X : E is linearly ordered} which we equip with the inclusion partial ordering. By 
2. there exist a maximal element E € ¥. By assumption, the linearly ordered set 
FE has an upper bound 2 € X. The element x is maximal, for if y € Y and y > a, 
then EU {y} is still an linearly ordered set containing E. So by maximality of E, 
E=EUf{y},ie. y € E and therefore y < x showing which combined with y > x 
implies that y = x." 


10Tf X is a countable set we may prove Zorn’s Lemma by induction. Let {an }P°., be an 
ennumeration of X, and define E, C X inductively as follows. For n = 1 let Ey = {x1}, and 
if Ey, have been choosen, let En41 = En U {tn41} if en41 is an upper bound for E,, otherwise 
let En41 = En. The set EF = US, Ep is a linearly ordered (you check) subset of X and hence 
by assumtion & has an upper bound, « € X. I claim that his element is maximal, for if there 
exists y = @m € X such that y > 2, then zm would be an upper bound for Em—1 and therefore 
y=2m € Em C E. That is to say if y > a, then y € E and hence y < x, so y = x. (Hence we 
may view Zorn’s lemma as a “ jazzed” up version of induction.) 

11Similalry one may show that 3 > 2. Let F = {E Cc X : E is linearly ordered} and order F 


by inclusion. If M C F is linearly ordered, let H=UM= ( A. If a,y €¢ E then « € A and 
AEM 

y € B for some A,B C M. Now M is linearly ordered by set inclusion so A C B or BC Aie. 

z,y € Aor az,y € B. Sinse A and B are linearly order we must have either ¢ < y or y < a, that 

is to say FE is linearly ordered. Hence by 3. there exists a maximal element E € F which is the 

assertion in 2. 
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(3 + 1) Let {Xa} ¢,4 bea collection of non-empty sets, we must show [<4 Xa 
is not empty. Let G denote the collection of functions g : D(g) > [].e4 Xa such 
that D(g) is a subset of A, and for all a € D(g), g(a) € Xa. Notice that G is 
not empty, for we may let ag € A and x € X,q and then set D(g) = {ao} and 
g(aq) = Zo to construct an element of G. We now put a partial order on G as follows. 
We say that f < g for f,g € G provided that D(f) C D(g) and f = g|pip). f® CG 
is a linearly ordered set, let D(h) = UgewD(g) and for a € D(g) let h(a) = g(a). 
Then h € G is an upper bound for ®. So by Zorn’s Lemma there exists a maximal 
element h € G. To finish the proof we need only show that D(h) = A. If this 
were not the case, then let ag € A \ D(h) and zo € Xq,. We may now define 
D(h) = D(h) U {ao} and 


~ h(a) if a€ D(h) 
ita) = { wm if a=apo. 


Then h < h while h o h violating the fact that h was a maximal element. 

(1 = 2) Let (X,<) be a partially ordered set. Let F be the collection of linearly 
ordered subsets of X which we order by set inclusion. Given zp € X, {xo} € F is 
linearly ordered set so that F 4 @. 

Fix an element Py € ¥. If Po is not maximal there exists P, € F such that 
Py & P,. In particular we may choose x ¢ Py such that Py U {x} € F. The idea 
now is to keep repeating this process of adding points « € X until we construct a 
maximal element P of F. We now have to take care of some details. 

We may assume with out loss of generality that F = {P € F : P is not maximal} 
is a non-empty set. For P € F, let P* = {x € X: PU{x} € F}. As the above 
argument shows, P* 4 () for all P € F. Using the axiom of choice, there exists 
f €T]pe% P*. We now define g : F — F by 


P if P is maximal 
(8.1) g(P) = { PU{f(x)} if P is not maximal. 


The proof is completed by the next lemma which shows that g must have a fixed 
point P € ¥. This fixed point is maximal by construction of g. ™ 


Lemma 8.8. The function g: F — F defined in Eq. (8.1) has a fixed point.” 


Proof. The idea of the proof is as follows. Let Py € F be chosen arbitrarily. 
Notice that @ = {g) (Po) } C F is a linearly ordered set and it is therefore 


easily verified that P, = U g'” (Po) € F. Similarly we may repeat the process to 
=0 


construct P, = U g™ (P,\) € F and Ps = i, g'”) (Px) € F, ete. etc. Then take 


Pe SUP 6 Fa ond: start again with Fo faplaeea by P... Then keep going this way 
until eventually the sets stop increasing in size, in which case we have found our 
fixed point. The problem with this strategy is that we may never win. (This is 
very reminiscent of constructing measurable sets and the way out is to use measure 
theoretic like arguments.) 

Let us now start the formal proof. Again let Py € F and let F; = {PeEF: 
Py C P}. Notice that F, has the following properties: 


12Here is an easy proof if the elements of F happened to all be finite sets and there existed a 
set P € F with a maximal number of elments. In this case the condition that P C g(P) would 
imply that P = g(P), otherwise g(P) would have more elements than P. 
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1. PoE Fy. 
2. If ® C F, is a totally ordered (by set inclusion) subset then U® € F,. 
3. If P € Fy then g(P) € Fy. 


Let us call a general subset F’ C F satisfying these three conditions a tower and 
let 


Fo =N{F': F' is a tower}. 


Standard arguments show that Fo is still a tower and clearly is the smallest tower 
containing Po. (Morally speaking Fo consists of all of the sets we were trying to 
constructed in the “idea section” of the proof.) 

We now claim that Fo is a linearly ordered subset of F. To prove this let [ C Fo 
be the linearly ordered set 


T={Ce€Fpo: for all A€ Fo either AC Cor Cc A}. 


Shortly we will show that [ C Fo is a tower and hence that Fy =I. That is to say 
Fo is linearly ordered. Assuming this for the moment let us finish the proof. Let 
P=UFo which is in Fo by property 2 and is clearly the largest element in Fo. By 
3. it now follows that P C g(P) € Fp and by maximality of P, we have g(P) = P, 
the desired fixed point. So to finish the proof, we must show that T is a tower. 

First off it is clear that Po € T so in particular [Tis not empty. For each C € T 
let 


®o := {AE Fo: either A CC or g(C) Cc A}. 


We will begin by showing that ®o C Fo is a tower and therefore that ®g = Fo. 

1. Py € ®o since Py C C for all CET C Fp. 2. If ® C Bo C Fp is totally 
ordered by set inclusion, then Ag := U® € Fo. We must show Ag € ®¢, that is 
that Ag C C or C C Ae. Now if A C C for all A € ®, then Ag C C and hence 
Ag € ®c. On the other hand if there is some A € ©® such that g(C) Cc A then 
clearly g(C) C A@ and again Ao € Bo. 

3. Given A € ®c we must show g(A) € ®o, ie. that 


(8.2) g(A) C C or g(C) c gf A). 


There are three cases to consider: either A ¢ C, A = C, or g(C) C A. In the case 
A=C, g(C) = 9(A) C g(A) and if g(C) C A then g(C) C AC g(A) and Eq. (8.2) 
holds in either of these cases. So assume that A & C. Since C € T, either g(A) C C 
(in which case we are done) or CC g(A). Hence we may assume that 


AGCC g(A). 


Now if C were a proper subset of g(A) it would then follow that g(A) \ A would 
consist of at least two points which contradicts the definition of g. Hence we must 
have g(A) = CC C and again Eq. (8.2) holds, so ®g is a tower. 

It is now easy to show that T is a tower. It is again clear that Py € T and 
Property 2. may be checked for I in the same way as it was done for ®¢ above. 
For Property 3., if C € T we may use ®g = Fo to conclude that for all A € Fo 
that either A C CC g(C) or 9(C) C A, ie. g(C) € T. Thus T is a tower and we 
are done. @ 
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9. NETS 


CAUTION: this section is unedited, hence very rough. 

In this section (which may be skipped) we develop the notion of nets. Nets are 
generalization of sequences. Let us begin by showing that for general topological 
spaces, sequences are not always adequate. 

We start by considering C(R) c C®. If {f,} C C(R) and f, — f pointwise 
(which is the notion of convergence in C®) then f is a Borel measurable function. 
Hence the sequential limits of elements in C'(R) is contained in the Borel measurable 
functions which is properly contained in C®. On the other hand we have the 


Claim 9.1. C(R) =C®. 
Proof. If f € C®, a typical neighborhood of f is 
N={gEC®: |g(x;) — f(a;)| < € fori=1,...,n}, 


where € > 0 and {2;}/_, is a finite subset of R. Clearly NM C(R) 4 @ so that 
fec(R). a 


Definition 9.2. A directed set (A,<) is a set with a relation such that 
l.a<a 
2. a< 8,8 <-~y implies a < y and 
3. if a, @ € A there exists y € A such that a < y and 6 < ¥. 
A net is function x: A — X where A is a directed set. We will often denote x 
by {®ataea- 


Example 9.3 (Directed sets). 1. A=2* :a<Gifac B. Notea<B,8<y¥ 
implies a C 6 C y implies a C y and ifa< ya, € 2* then a < aU and 
BSaUZ. 

2. A = 2* : a < 6 if B C a reverse inclusion. Say a < 6,8 < ¥ implies 
a2 D~vyimpliesaDyona<y.a,8B€A aDaNnPB,BD aN implies 
a, Ban. 


Definition 9.4. Let {ta} ge, C X be a net then 


© fq — x, as iff for all V € Tt VQ € V eventually i.e. there exists G = Gy € A 
such that for ala>Ga2,€V. 

e x isa cluster point of {va}aca if for all V € tT, va € V frequently, i.e. for 
all G € A there exists a > @ such that x, € V. 


Proposition 9.5. Let X be a topological space and E Cc X. Then 


e x is an accumulation point of E iff there exists net {tq} C E \ {x}such that 
La > 2. 


oe «CE iff there exists {x} C E such that tq > @. 
Proof. 


e Say x is an accumulation point of E. 
A =T, by reverse set inclusion for all a € T, choose tq € (a\ {z}) NE. Then 
given V € 7, for alla >V ie. anda CV,2%q € V implies ry > @. 

e Conversely If {tasaea C E\{x} and x, — «# then for all V € 7, there exists 
@ € Asuch that xq € V for all a > @ in particular ry € (E\ {x})NV #9. 
So x€ A, < (E). 
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e Recall E = EU acc(E),acc(E) = Accumulation points of E. For clearly 
ace(E) C E so EUacc(E) C E. Conversely if « ¢ (EU acc(E)) implies 
x ¢ E and x ¢ acc(£) implies there exists V € 7, such that VN (£ \ {x}) = 
VnN£E=9%. Showing E U acc(£) is closed. Thus FE Cc E Uacc(£). Therefore 
if x € E = EUacc(E£) then if z € E take x, = 2 if x € acc(E) take z, as 
above. One easily sees if {ta}saca C E and xq — x then x € E. 
a 


Proposition 9.6. f : X — Y is continuous at x iff f(ta) — f(x) for allay — «x. 


Proof. f is continuous, x2 — x then given V € Ty(z) there exists W € Tz 
such that f(w) C V. So rq € W eventually implies f(z.) € V eventually implies 
f(a) > f(x). 

Conversely If f is not continuous at x. Then there exists W € Ts(,) such that 
for all V € t% f(V) C W. For all V € tT, choose zy € W \ f(V) (Axiom of choice). 
Then zy — x as we have seen above. While f(ay) € W° so f(xy) # f(x). = 


Definition 9.7 ( Subnet). (ta)aea is a net (yg)geg is a subnet if there exists 
GB — a such that 

(i) yg = ag for all GE B 

(ii) for all ag € A there exists 39 € B such that for all 6 > Go aB > ao. 


Proposition 9.8. (a)aca is a net, x is a cluster point of (ta)aca iff there exists 
a subnet (ys)geB such that yg > x. 


Proof. Suppose yg = tag — x and W € Tz and ag € A there exists 49 € Bsuch 
that yg € W for all 6 > fo. i.e. tag € W for all G > Go. Choose G, € B such that 
ag > ag for all 6 > GB; then choose 3 € B such that 63 > 6, and 63 > Gy then 
afb > ag and rag € W for all 6 > 63 implies xy € W frequently. 

Conversely: Assume z is a cluster point of (t%a)aea- Consider 7,2A with 
(U,a) < (U',a’) iff a< a’ and U DU’. For all (U,y) € TexA. Choose ayy,,) > 7 
in A such that yyy) = Tay,,. € U. Then if ao € A for all (U’, 7’) = (U, a0) ie. 
y > ag and U' CU ayy) = ¥ = ao implies ayy 4) = a0. 

Moreover, Given W € 7, then yu,y) € U C W for all U C W. Hence fixing 
a € A we see if (U,y) > (W,a) then yu) = Tay,,. € U C W showing that 
Eg) 


Exercise 9.9. [#34, p. 121] 
Let (%a)aea be a net in a topological space and for each a € A let E, = {xg : 
8 >a}. Then z is a cluster point of (xq) iff e () Eo. 
acA 
Proof. If x is a cluster point, then given W € 7, we know Ea 1W # @ for all 


a € EF since xg € W frequently thus 2 € E, implies x € () Ea. 
acA 
Conversely: If x is not a cluster point of (x,,) then there exists W € 7, and 


a € A such that xg ¢ W for all 8 > aie. WN E, = ie. x ¢ Ey implies 
r¢é() Eq ow 


acA 


Theorem 9.10. X is compact iff Every net has a cluster point. 


Proof. Let X be compact and (ta)aea C X. Set Fy = {xg : 8 >a}. Now Fy 
is closed, Fa, N---OFo,, 2 F, provided y > aj,...i = 1,...,n which exists since A 
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FIGURE 3. (cirx) 


is directed. Therefore Fy, ---N Fa, Adie. {Fa}aea has the finite intersection 

property. X is not compact implies there exists x € (] Fa. By the above problem 
aca 

implies x is a cluster point of (ta)aea. If X is not compact let {Ug}sep be an 

infinite cover with no finite subcover. Let A = {a C B: #a < co} ordered by 


inclusion. for a € A choose rq € X \ ( U Us) #Q. Then (vq)aea is a net in X. 
Bea 


Claim 9.11. it has no cluster point. For if « € X choose 3 such that x € Ug. 


Then foralla>{G} ie. BE ate € VU Ug D Ug i.e. ty ¢ Ug implies x is not 
yea 
a cluster point of (xq). 


10. BANACH SPACES 
Let F denote either C or R. 


Definition 10.1. A norm on a vector space X is a function ||-|| : X — [0,00) such 
that 


1. (Homogeneity) ||Az|| = |A| ||z|| for all Ae C and a € X. 
2. (Triangle inequality) ||z + y|| < ||2|| + |ly|| for all x,y € X. 
3. (Positive definite) ||2|| = 0 implies x = 0. 


A pair (X,||-||) where X is a vector space and ||-|| is a norm on X is called a 
normed vector space. 


Definition 10.2. If (X, ||-||) is a normed vector space, then we say {2% }>, C X 
is a Cauchy sequence if lim,, 00 ||@m — %n|| = 0. The normed vector space is a 
Banach space if it is complete, i.e. if every {z,}°°., C X which is Cauchy is 
convergent where {x,}"-_, C X is convergent iff there exists  € X such that 
limp—oo ||@n — x|| = 0. As usual we will abbreviate this last statement by writing 
lim;,-s60 fn = L: 


Theorem 10.3. A normed space (X,||-||) is a@ Banach space iff for every sequence 
N 


CO 
{xn }r°, such that > ||zn|| < co then limyo D> tn = S exists in X (that is to 
n=1 n=1 
say every absolutely convergent series is a convergent series in X). As usual we 
co 
will denote S by S> an. 


n=1 
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Proof. (=)If X is complete and pI \|z,|| < oo then sequence Sy = > Ly, for 


n=1 
N €N is Cauchy because (for N > M) 
N 
[Sv — Sill < $2 |lanl| + 0 as M,N = oo, 
n=M+1 


ThereforeS = pS In = limy—oo Ss Yn exists in X. 


=1 
(<=) Suispose that: {7} Ses a Cauchy sequence and let {yz = %n, }72, bea 


CO 
subsequence of {x,}°°_, such that S> ||yn41— Yn|| < co. By assumption 
n=1 


N co 
YN41 — Y= So Unti-y 2 Yn+1 — Yn) EXasN—w. 


n=1 


This shows that limy—.o yw exists and is equal to x := y; + S. Since {z, eae is 
Cauchy, 


Iz — tp|| < [|e — Yell + lye — tn|| + 0 as k,n — 00 
showing that lim,_..o Z» exists and is equal to x. & 
Example 10.4. We have the following examples of Banach spaces. Suppose that 
X is a set then 
1. The bounded functions B(X) on X is a Banach space with the norm 


Il fll = sup | f(x)| 
eEX 


and 

2. if X is a topological space the subspace BC(X) C B(X) is closed and hence 
also a Banach space in the above norm. 

3. If (X,M, 1) is a measurable space then L1(X,M, dj) is a Banach space with 


fll = : flay 


provided that we agree to identify functions f of g which agree ju — a.e. 


Definition 10.5. Let X and Y be normed spaces and T': X — Y be a linear 
map. Then T is said to be bounded provided there exists C < oo such that 
\|T'(ax)|| < C]|x\|x for all « € X. We denote the best constant by ||T'||, ie. 


[21] = sup SM — sup {CI : fal] = 0. 


The number ||T'|| is called the operator norm of T. 


Notation 10.6. Let L(X,Y) denote the bounded linear operators from X to Y. 


Remark 10.7. (1) The operator norm is a norm on the vector space L(X,Y). (2) 

Moreover if T: X — Y and S: Y — Z are linear maps between normed vector 

spaces then ||ST'|| < ||S||||Z']|, where ST’ := SoT. For example the triangle inequality 

is verified as follows, if A,B € L(X,Y) then 

Av Bol Anil + Bel) 5 Ac, Be 
2" 7 Ael x0 [lzl| 240 (lal 


|A+ Bl =e = ||All + III. 
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For the second remark we have for x € X, ||ST'x|| < ||S||||Z|| < |[S|]||T]||z|| from 
which it follows that ||ST'|| < ||S||||Z'l]. 


Proposition 10.8. Suppose that X and Y are normed spaces andT : X — Y is 
a linear map. The the following are equivalent: 

(a) T is continuous. 

(b) T is continuous at 0. 

(c) T is bounded. 


Proof. (a) = (b) trivial. (b) = (c) If T continuous at 0 then there exist 6 > 0 
such that ||Z(x)|| < 1 if ||a|| < 6. Therefore for any x € X, ||T (6z/||2||) || < 1 which 
implies that ||T'(x)|| < $||x|| and hence ||T|| < $ < oo. (c) > (a) Let x € X and 
€ > 0 be given. Then 

ITY) — Te) = ITw—- 2) < ITI Ily- all <e 
provided ||y— a|| <e/||T||=6. = 

The following simple theorem is often useful for defining bounded linear trans- 
formations. 


Theorem 10.9 (B.L.T. Theorem). Suppose that X is a normed space, Y is a Ba- 
nach space, and D C X is a dense linear subspace of X. Suppose that T: D— Y 
is a linear transformation and there exists C < oo such that ||Tx|| < C'||x|| for all 
x €D. Then T has a unique extension to an element of L(X,Y). 


Exercise 10.10. Prove Theorem 10.9 
Exercise 10.11. Suppose that X is a Banach space, I = [a,b] with —co <a < 
b < oo. For a function f : J > X, let ||f|| = sup {|| f(@]||x :¢ € I} and define 

¥ ={f: 1X: |lfll <co}. 
Show (Y,||-||) is a Banach space. 
Example 10.12. Let X be a Banach space, I = [a,b] with —-co <a <b < ow 
and (Y,||-||) be the Banach space as in Exercise 10.11. Let D Cc Y denote those 
functions f € Y of the form f(t) = S*"_, xj1a,(¢), where A; € B (the Borel o — 


algebra on I) and x; € X. Alternatively put, f € D provided that f : I-X isa 
bounded simple function. For f € D, let 


I(f) = S¢ am(fe ({2}). 
rex 


Just as for real valued functions one shows that J : D — X is linear. Moreover for 
Pep, 


ZA) = So emf (fe}) 


rEX 
= flrOllame < m(D)|Ifll. 


This shows that I is bounded and therefore by Theorem 10.9, J has a unique 
bounded extension to D — the closure of D in Y. 


< S |lell mf =2}) 


cEeX 


Exercise 10.13. Show that C(I — X) C D. Hence the above example constructs 
the integral of f € C(I > X). 
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Exercise 10.14. Let X = R” and Y = R” and T: X — Y bea linear transfor- 
mation so that T is given by matrix multiplication by an m x n matrix. Let us 
identify the linear transformation T with this matrix. 


1. (*) Assume the norms on X and Y are the ¢! — norms, i.e. for x € R”, 
I|x|| = SU*_, |x;|. Then the operator norm of T is given by 


m 
IZ = max, S17: 
i 


2. Assume the norms on X and Y are the @° — norms, i.e. for « € R”, ||z|| = 
max1<j;<n |x;|. Then the operator norm of T is given by 


n 
Tl] = max So |T5l- 
1l<i<m¢ | 

J= 


3. (*) Assume the norms on X and Y are the @ — norms, i.e. for x € R”, ||x||? = 
ya a Show alle is the largest eigenvalue of the matrix T’’T : R” — R”. 


Example 10.15. If X is finite dimensional normed space then all linear maps are 
bounded. 


Example 10.16. Suppose that K : [0,1] x [0,1] — C is a continuous function. Let 
T : L' ((0,1],dm) — C((0,1]) be defined by 


(TF)(«) = | K(e,y)Fly)ay. 


It is easily checked that this map is linear and maps to C((0, 1]) as advertised. (Use 
the dominated convergence theorem.) If M is a bound for |K|, then 


\(TF)(2)| < i K(x.) Flay < M [If ll, 


which shows that ||T'f||,, <M ||f||, and hence that 
Trice < max {|K(x,y)] + x,y € (0, 1]} < oo. 


We can in fact show that ||T|| = M as follows. Let (xo,yo) € [0,1]? such that 
|K (20, yo)| = M. Then given € > 0, there exists a neighborhood U = I x J of 
(xo, yo) such that |K (a, y) — K (xo, yo)| < € for all (a, y) € U. Let f € C.(, [0, 00)) 
such that ig f(a)dx = 1. Choose a € C such that ja| = 1 and aK (29, yo) = M, 
then 


\(Laf\(2)| = | | K(e0.u)af(a)ay a | [ K(co.artuay 
> Re i ak (10,9) fly)dy > | (M —€) f(ydy = (M —)|lafllys 


and hence 
ITofllo = (M—€)llefllp: 


showing that ||T|| > 14 — «. Since € > 0 is arbitrary, we learn that ||7'|| > M and 
hence ||T|| = M. 
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Similarly one easily shows that T|c,jo,1)) : C([0, 1]) + C({0, 1]) is bounded and 
[be | Pree s{ [ |K(x,y)| dy: a € [0, uj} <0, 
One may also vies T : C((0,1]) > L'({0,1]) in which case 
ITs sf mgxiK(2,2)\ ae <x. 


Proposition 10.17. Suppose that X is a normed vector space and Y is a Banach 
space. Then (L(X,Y),||- |lop) is a Banach space. 
Proof. We must show (L(X,Y),||-|]op) is complete. Suppose that T,, €« L(X,Y) 


CO 
is a sequence of operators such that 5> ||T;,|| < oo. Then 


n=1 
loc) CO 
So IZaell < 52 [Tall ll] < 00 
n=1 n=1 
[oe] 
and therefore by the completeness of Y, Sx := >> T,% = limy. Sy exists in 


n=1 
N 
Y, where Sy := 5> T,. The reader should check that S : X — Y so defined in 
n=1 
linear. Since, 


N oo 
Sa = im Svar < im, Yaa < 0 Fal al 
bf St 


n=1 


S is bounded and 


(10.1) ISI] < $5 |ITall- 
n=1 
Similarly, 
N love) 
Sx — Sya|| = Jim ||Sve—Syel| < tim S> Tall llell = YD UTal el 
n=M+1 n=M+1 


and therefore, 


|S — Sul < S> ||Tnl| + 0 as M — 0. 
n=M 
| 


Definition 10.18. Let JT: X — Y bea linear map between normed spaces X and 
Y. Then T: X — Y is an isometry if ||Tz|| = ||x|| for all w ¢ X andT: X — Y 
is invertible if T is a bijection and T—! is bounded. 


Proposition 10.19. Suppose X is a Banach space and T € L(X) = L(X,X) 
satisfies S~ ||T"|| < co. Then I —T is invertible and 
n=0 


1 co Co 
(I-T)t = “aH = DET” and || - 7) |S SOIT" 
=0 =0 
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In particular if |\|T|| < 1 then the above formula holds and 


I-T)'||< : 


Proof. Let Sy := 2 T”. By Proposition 10.17, S = 3 T” := limn_.0 Sn 
n=0 
exists in L(X). Mivicover, 
(10.2) (I-T)Sy = Sy(I-T) =1-TN*1 4 Te L(X) as N > ©. 


Since for any A € L(X), || AS — ASy]|| < ||Al| |S —Sy|| — 0 as N — oo and 
||SA — Sy Al| < ||Al| ||S — Sn|| — 0 as N — ov, it follows from Eq. (10.2) that 
(I-T)S = S(I—T) = I. This shows that(I — T)~' = S and the bound on 
(I — T)~! follows from Eq. (10.1). Furthermore, if ||T|| <1, then |/Z”|| < ||T\|” 
and 


Yin es doin" < maqn< 


proving the last assertion in the statement. ™ 


Corollary 10.20. Let L*(X) denote the invertible elements in L(X). Then L* (X) 
is an open subset of L(X). More specifically, if AE L*(X) and B € L(X) satisfies 


(10.3) |B All <A 
then B € L*(X). 
Proof. Let A and B be as above, then 
B=A-(A-B)=A[I-A™‘(A-B))] 
and 
||A-"(A- B))|] < ATA — BI < JAM IAT I = 1 
Therefore [J — A~!(A — B))] is invertible and hence so is B with 


Bl =[1-A-'(A-B))]' AT. 
Notice that 


|B <f- 474 - By ats 47 


1 
1— ||A~*(A— B))|| 
1 


< ||A7! ; 
$414 — BI 


| 
10.0.1. Application. Consider the linear differential equation 
(10.4) a(t) = A(t)x(t) where x(0) = xq € R”. 


Here A € C(R — L(R")) and x € C'(R — R"). As usual this equation may be 
written in its equivalent integral form, i.e. we are looking for x € C(R,R”) such 
that 


(10.5) x(t) = Xo +f A(r)a(r)dr. 
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Theorem 10.21. Let ¢ € C((0,T], R”), then the integral equation 
(10.6) x(t) = &(t)+ [ A(r)2(1)dr 
has a unique solution given by ; 
a(t) = p(t) + » a As A(t)... A(t1)@(tn)dt1 ... dT 


where 


A, (t) ={0< 14 <-:-<™ <#h. 


Moreover, 
|x(t)| < ||dl| elo Alar, 
Proof. Define A: C([0,7],R”) — C([0, 7], R”) by 
t 
(A= | A(r)ax(r7)dr. 
0 
Then x solves Eq. (10.5) iff = $+ Az or equivalently iff (J — A)x = ¢. The 


theorem will be proved by show (IJ —.A)~! exists and > ||A”|| < co. An induction 
n=1 


argument shows 


(A @)(t) = ‘ dt, A(Tn)(A""9)(Ta) 


= [ aes i; hr a AEA (AANA) 


A(t)... A(m1)O(1)dr ...dt™ 


O<71 SST, ST 
= i. A(t)... A(t1)@(tn)dt ... dT. 


Hence 


|(A"4) (Inn < | / | Am) latent |All 
DS) SST <7 


Therefore 


A" s ||A(ta)|| -. AC) llarr «dtm 
0<11 << <T 
1 
= nl / ||A(m) ||... || AQ) ld... dtm 
[o,7\" 


(10.7) -({ \acrlr) 
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Alternatively, one can prove this last equality by induction on n. Namely let 


F(t) = i \|A(r)||ar 


then by induction one shows that 


1 1 
E(t\s= ||A(t)||..- || A(m) ld... dt = ae (t). 
O<t1 << <P 
Indeed, 
eal : e ay - a 1 
I t) = —F"(r)F(r)dt = — = Ft (7dr = ——__ F(t 
n+i(t) i n! ua) de i (n+ 1)! dr (er (n+ 1)! () 


proving Eq. (10.7) again. Using this estimate we then have 
A” || < elo A@MIler < go, 


n=0 


Therefore (I — A)~! exists and (I —.A)~! = S> A” and 


n=0 
(2 — Ay] < ele HA@llar 


10.1. More about sums in Banach spaces. 


Definition 10.22. Suppose that X is a Normed space and {vg € X:a€ A}isa 
given collection of vectors in X. We say that s = )0,¢4 Ua € X if for all « > 0 
there exists a finite set [, C A such that Ils =) eR Val|| <¢foral ACC A 
such that [. c A. (Unlike the case of real valued sums, this does not imply that 
aca ||Val| < co. See Proposition 12.16, from which one may manufacture counter- 
examples to this false premise.) 


Lemma 10.23. (1) When X is a Banach space, So ,c,4 Va exists in X iff for all 
€ > O there exists T. CC A such that Sven Vall| < e¢ for all A cc A\ Te. 
Also if uea Va exists in X then {a © A: Ua #0} is at most countable. (2) If 
8 = Vaca va € X exists andT:X —Y is a bounded linear map between normed 
spaces, then do c4 IVa exists in Y and 


Tea yo 05 = So Tv. 
acA acA 


Proof. (1) Suppose that s = )),¢4 Va exists and € > 0. Let TP, CC A be as in 
Definition 10.22. Then for ACC A\T., 


y Val| < y vat 5 Vq — Sil + y V6-— Ss 
acA acA acl. acl. 
= y Va — s|| te < 2e. 
aél UA 
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Conversely, suppose for all « > 0 there exists [, CC A such that >> 
for all ACC A\ Ty. Let Ym := URTV 1, C A and set 8, := 5° 
m>n, 


acA Va| <€ 


acy, Var Then for 


llSm — 8n|| = S> Va|| < 1/n — 0 as m,n — ov. 
AE Ym \In 


Therefore { s,, ae is Cauchy and hence convergent in X. Let s := limy—.o6 Sn, then 
for Acc A such that y, C A, we have 


SDC Us 


acA 


1 
< ||s — sn|| + S- Vox < ||s— snl + —. 
acA\yn 


Since the right member of this equation goes to zero as n — oo, it follows that 
aca Va exists and is equal to s. 

Let y := Ue — a countable subset of A. Then for a ¢ y, {a} C A\ Ym for all 
nm and hence 


\|val| = a vel] <1/n > 0 as n> ow. 
BEf{a} 
Therefore vg = 0 for alla € A\¥. 
(2) Let I, be as in Definition 10.22 and A cc A such that [, c A. Then 


Ts— Tro s— > v. 


acA aca 


< ||T'| <||Tlle 


which shows that }°,-, [va exists and is equal to T's. m 


11. DUAL SPACES X* 


Notation 11.1. If X is a normed space we denote the Banach space L(X,F) by 
X* and refer to X* as the (continuous) dual space of X. 


Proposition 11.2. Let X be a complex vector space over C. If f € X* andu= 
Ref € Xq then 


(11.1) f(x) = u(x) — iu(iz). 


Conversely ifu € Xz and f is defined by Eq. (11.1), then f € X* and |lul|x: = 
\|fllx«. More generally if p is a semi-norm on X, then 


fl <p iffusp. 
Proof. Let v(x) = Im f(z), then 
v(ix) =Im f(ix) = Im(if(x)) = Ref(z) = u(z). 
Therefore 
f(x) = u(x) + iv(x) = u(x) + iu(—ix) = u(x) —iu(iz). 
Conversely for u € X@ let f(x) = u(x) — iu(ix). Then 
f((a+ib)x) = u(ax + ibx) — iu(iax — br) = au(x) + bu(tx) — t(au(ix) — bu(x)) 

while 


(a + 2b) f(x) = au(ax) + bu(ix) + i(bu(x) — au(iz)). 
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So f is complex linear. 
Because |u(x)| = |Ref(x)| < |f(x)|, it follows that ||u|] < ||f||. For « © X choose 
A € S' CC such that |f(z)| = Af(z) so 
[f(@)| = fx) = u(Az) < flu] |]Azl] = [ellie 
Since x € X is arbitrary, this shows that || f|| < ||u|| so || || = |Jul|.18 
For the last assertion, it is clear that |f| < p implies that u < |u| < |f| < p. 
Conversely if u < p and x € X, choose \ € S$! C C such that |f(x)| = Af(x). Then 


|f(z)| = Af(z) = fx) = u(Az) < pz) = p(z) 
holds for all xz € X. ug 


Definition 11.3 (Minkowski functional). p: X — R is a Minkowski functional if 


1. p(x@t+y) < p(x) + p(y) for all x,y € X and 
2. p(cx) = cp(z) for allc > O and rE X. 


Example 11.4. Suppose that X = R and 
p(x) =inf {A> 0:2 € A[—-1, 2] = [-A, 2d} . 
Notice that if x > 0, then p(x) = x/2 and if x < 0 then p(x) = —a, ie. 


_f «/2 if «>0 
v(e)={ je] if «<0. 


From this formula it is clear that p(cx) = cp(x) for all c > 0 but not for c < 0. 
Moreover, p satisfies the triangle inequality, indeed if p(a) = and p(y) = pw, then 
x € \[-1,2] and y € y[-1, 2] so that 

z+y €N-1,2) + l-1,4)c (A+) [-1,2 
which shows that p(x + y) < A+ “ = p(x) + p(y). To check the last set inclusion 
let a,b € [—1, 2], then 


Aa + pb = (A4 w (522 +) (A + pb) [-1, 2] 


since [—1, 2] is a convex set and —] +5f,=1 


Theorem 11.5 (Hahn-Banach). Let X be a real vector space, M C X be a sub- 
space f : M > R be a linear functional such that f <p on M. Then there exists a 
linear functional F': X — R such that F|\y, = f and F <p. 


13 


Proof. To understand better why ||f|| = |/u||, notice that 
fl? = sup [f(2)? = sup (w()|? + |u(éa)|?). 
Iz |=1 2 ]=1 
Supppose that M = sup |u(x)| and this supremum is attained at 29 € X with ||zo|| = 1. 
lz |=1 


Replacing zo by —xo if necessary, we may assume that wu(ro) = M. Since u has a maximum at 


Zo, 
d ( xo + itxo ) 
0= u - 
dt | |zo + txo|| 
f) {2 (u(ao) + tu(ino)) } = (ino) 
= u(x + tu(e7a = u(t 
dt|, | |i +t . ’ ? 


since # loll + it| = Llovi + ¢? = 0.This explains why ||f|| = |/u||. = 
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Proof. Step (1) We show for all z € X \ M there exists and extension F' to 
M & Re with the desired properties. If F exists and a = F(z), then for all y € M 
and \ € R we must have f(y)+Aa = F(y+Az) < p(y+Az) ie. Aa < p(y+Ax)— f(y). 
Equivalently put we must find a € R such that 


ac Ry tr) = f(y) 
= 5 


for ally € M and A >0 


plz — pa) ~ f) 
m 
So if a € R is going to exist, we have to prove, for all y,z € M and A, uw > 0 that 
f(2) — pt — Ha) — ply + Ax) — fly) 
[Lb i » 


a> 


for all z€ M and p> 0. 


or equivalently 


(11.2) fz + py) < uply + Ax) + Ap(z — Bx) 
= (uy + pAx) + p(Az — Aux). 


But 


fAz + my) = f(Az + pA) + f(Az — Ape) 
< p(Az + pax) + p(Az — Aux) 


which shows that Eq. (11.2) is true and by working backwards, there exist an a € R 
such that f(y) + Aa < p(y + Ax). Therefore F(y + Ax) := f(y) + Aq is the desired 
extension. 

Step (2) Let us now write F': X — R to mean F is defined on a linear subspace 
D(F) c X and F:: D(F) = Ris linear. For F,G: X — R we will say F < G if 
D(F) C D(G) and F = G|p:p), that is G is an extension of F. Let 


F={F:X =R:MCc D(F), F<pon D(F)}. 


Then (F,<) is a partially ordered set. If ® C F is a chain (i.e. a linearly ordered 
subset of F) then ® has an upper bound G € F defined by D(G) = (J D(F) and 
FEe® 


G(x) = F(x) for x € D(F). Then it is easily checked that D(G) is a linear subspace, 
G € fF, and F < G for all F € ®. We may now apply Zorn’s Lemma to conclude 
there exists a maximal element F € F. Necessarily, D(F’) = X for otherwise we 
could extend F by step (1), violating the maximality of F. Thus F is the desired 
extension of f. m 


Corollary 11.6. Suppose that X is a complex vector space, p: X — (0,00) is a 
semi-norm, M Cc X is a linear subspace, and f : M — C is linear functional such 
that |f(x)| < p(a) for all x © M. Then there exists F © X' (X’ is the algebraic 
dual of X) such that Fly =f and |F| <p. 


Proof. Let wu = Ref then u < pon M and hence by Theorem 11.5, there exists 
U € Xf such that U|,y; =uand U < pon M. Define F(x) = U(a) — iU(ix) then 
as in Proposition 11.2, F = f on M and |F| <p. m 


Theorem 11.7. Let X be a normed space M Cc X be a closed subspace and x € 
X \ M. Then there exists f € X* such that ||f|| = 1, f(x) = 6 = d(x, M) and 
f =0o0nM. 
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Proof. Define f: M@Cx— C by f(m+Az) = 6 for allm € M and XA €C. 
Notice that 


||m + Axl] = |Al||z + m/Al| > [Ald 
and hence 
|f(m + Ax)| = |A|6 < ||m + Aa 


which shows || f|| < 1. In fact, since | f(m+2x)| =6= inf ||| +mll, ||f|| = 1. By 


Hahn-Banach theorem there exists F € X* such that F|arece = f and |F(x)| < ||| 
for all x € X, ie. ||F'|| < 1. Since 1 = ||f|| < ||F'|| < 1 we see ||F'|| = ||f||. = 


Corollary 11.8. The linear map « € X > & © X** where &(f) = f(x) for all 
x € X is an isometry. (This isometry need not be surjective. ) 


Proof. Since |%(f)| = |f(x)| < ||fll.x» ||zl|, for all f € X*, it follows that 
||| yas < ||2||y . Now applying Theorem 11.7 with M = {0}, there exists f € X* 
such that ||f|| = 1 and |@(f)| = f(x) = ||2||, which shows that ||Z||y.. > ||a||y. 
This shows that « © X — & € X*™ is an isometry. Since isometries are necessarily 
injective, we are done. @ 


Definition 11.9. A Banach space X is reflexive if the map « € X — # € X™ is 
surjective. 


11.1. Weak Topology. 


Definition 11.10. (1) Weak topology on X is the topology generated by X*. i.e. 
sets of the form 


N=Nhi{e eX: |fi(x) — fi(ao)| < €} 


where f; € X* and € > 0 form a neighborhood base for the weak topology on X at 
wo. 
(2) The Weak-* topology on X™* is the topology generated by X, i.e. 


N=nhif{g € X* : |f(xi) — g(ai)| < €} 


where x; € X and e > 0 forms a neighborhood base for the weak-* topology on X* 
at f € X*. 


Theorem 11.11 (Alaoglu’s Theorem). If X is a normed space the unit ball in X* 
is weak - * compact. 


Proof. For all z € X let D, = {z € C: |z| < ||az||}. Then D, C Cisa 


compact set and so by Tychonoff’s Theorem 2 = [| D, is compact in the product 
cEeX 


topology. If f € B= {f € X*: |Ifl] <1}, |F@| < Iifll [all < lla] which implies 
that f(a) € D, for alla € X,ie. BC Q. The topology on B inherited from 
the weak-*« topology on X* is the same as that relative topology coming from the 
product topology on Q. So to finish the proof it suffices to show B is a closed subset 
of the compact space 2. To prove this let 7,(f) = f(a) be the projection maps. 
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Then 
B=({f€Q: f is linear} 
={f EQ: f(at+cy) — f(x) —cf(y) =0 for all z,y © X andc Ee C} 
(1) (if e@: f@ + ey) — Fe) — f(y) = 0} 


xyEex cEC 


1) 0) Gretey — te — ony) ({0}) 


xyEex cEC 


which is closed because (Tz+4ey — Tz — CTy) : Q— C is continuous. 
Definition 11.12. Strong and weak operator topologies on L(X, Y) are the small- 
est topologies such that 


1. Strong Te L(x,Y) — Tx €/Y is continuous for all « € X. 
2. Weak Te L(X,Y) —  f(Tx) € C is continuous for all x € X and f € Y*. 


12. HILBERT SPACES 
Definition 12.1. Let H be a complex vector space. An inner product on H is a 
function on (-,-) : H x H — C such that 


1. (ax + by, z) = a(x, z) + bly, z) ie. x > (2, z) is linear. 


2. (x,y) = (y,@). 
3. ||z||? = (x, x) > 0 with equality ||z|? = 0 iff x =0. 


Notice that combining properties (1) and (2) that 2 — (z,z) is anti-linear for 
fixed z € H, i.e. 


(2, aa + by) = G(z,x) + b(z,y). 


We will often find the following formula useful: 


Iz + yl? =(a@ty,0+y) = |x|]? + lull? + (zy) + 2) 
(12.1) = |lx||? + |ly|]? + 2Re(z, y) 


Theorem 12.2 (Schwarz Inequality). Let (H,(-,-)) be an inner product space, 
then for all x,y € H 


(x, 9)| < lleli[lyl 


and equality holds iff x and y are linearly dependent. 


Proof. If y = 0, the result holds trivially. So assume that y 4 0. First off notice 
that if 2 = ay for some a € C, then (x,y) = a|y||? and hence 


2 
(x,y) = Jal llyll” = lleiilyl- 


Moreover, in this case @ := ae. 


Now suppose that x € H is arbitrary, let 


(a4) 
zZ=u-——y. 
Ily|I? 
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(So z is the “orthogonal projection” of x onto y.) Then 

(x,y) 

llyll 
| 


= ||2||? - 


rt 


2 2 
= ||x 2, Ke,y)| y 2_ Re eee 
lel + ye — Rete ev) 


—y 
x,y)|? 
IIy||? 


0< lal? = | 


| 
( 


from which it follows that 
0< |lyll7ilell? — \(x,¥)P 
with equality iff z = 0 or equivalently iff 


_ (yy 
Ilyll? 
a 
Corollary 12.3. Let (H, (-,-)) be an inner product space and ||x|| := \/(x,x). Then 


||- || ts a norm on H. Moreover (-,-) is continuous on H x H, where H is viewed as 
the normed space (H,||-||). 


Proof. The only non-trivial thing to verify that ||-|| is a norm is the triangle 
inequality: 


lle + yl? = lla? + Ilyll? + 2Re(a,y) < lla? + llyll? + 2Klzll lly 
= (lll + Ilyll)? 


where we have made use of Schwarz’s inequality. Taking the square root of this 
inequality shows ||x + y|| < ||x|| + ||y||. For the continuity assertion: 


iz, 4) — (z",y’)| 


Coa) en CP hee | 

lylllla — 2] + llz"IIIly — y'll 

lyl|la — 2"|| + lal] + lle — 2'Il) ly — yl 
wlll] — 271] + llellly — yl + lle — 2'Illly — 9'll 


from which it follows that (-,-) is continuous. 


IN IA 


Definition 12.4. Let (H,(-,-)) be an inner product space, we say z,y € H are 
orthogonal and write x | y iff (x,y) = 0. More generally if A C H is a set we 
say x is orthogonal to A and write x 1 A iff (x,y) = 0 for all y € A. We also 
introduce the set 
At={reH:a1 A}. 

We also say that a set S C H is orthogonal if x | y for all x,y € S such that x 4 y 
and if S' also satisfies ||z|| = 1 for all x € S, then S is said to be orthonormal. 
Proposition 12.5. Let (H,(-,-)) be an inner product space then 

1. (Parallelogram Law) 


(12.2) IIx + yl? + Ile — yl? = lla? + lly? 


for allz,y € H. 
2. (Pythagorean Theorem) If S Cc H is a finite orthonormal set, then 


(12.3) Ido 21? = So lel. 


LES rES 
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3. If AC H is a set, then A+ is a closed linear subspace of H. 


Remark 12.6. See Proposition 12.28 in the appendix below for the “converse” of 
the parallelogram law. 


Proof. I will assume that H is a complex Hilbert space, the real case being 
easier. 


(1) For z,y € H, 
lla + yl? + lla — yll? = llel? + llyl? + 2Re(a, y) 
+ |[x||? + llyll? — 2Re(ax, y) 
= 2lla||? + 2Klyll?. 


(2) This is a simple computation 


[2a Se aS Se) 


Les xrES yEeES Leyes 
= So (e,2) =o lel? 
LES LES 


(3) This is a consequence of the continuity of (-,-) and the fact that 
At =NMeeA ker((-, x)) 
where ker((-,x)) = {y € H: (y,x) = 0} —a closed subspace of H. = 


Definition 12.7. A Hilbert space is an inner product space (H, (-,-)) such that 
the induced Hilbertian norm is complete. 


Definition 12.8. A subset C' of a vector space X is said to be convex if for all 
x,y € C the line segment [x,y] := {ta +(1—t)y:0<t< 1} joining z to y is 
contained in C' as well. (Notice that any vector subspace of X is convex.) 
Theorem 12.9. Suppose that H is a Hilbert space and M C H be a closed convex 
subset of H. Then for any x € H there exists a unique y © M such that 


— y|| =d(a, M) = inf ||a — 2]. 
r= yl] = a(x, M) = inf Jo 2 
Moreover, if M is a vector subspace of H, then the point y may also be characterized 
as the unique point in M such that (x — y) L M. 


Proof. Let y, € M such that ||z — yn|| = bn — 6 = d(z,M). Then by the 
parallelogram law, 


Q\|a — Yall? + 2||e — yall? = |]2a0 — (Yn + Ym)II? + lly — Yall? 
(Yn + Ym) ) 
p) 


=Al|x 
(12.4) > 48? + |l¥m — Yall? 


where we have used the fact that M is convex so that (yp, + Y%m)/2 € M. Letting 
m,n — oo in the previous inequality implies 


26? + 262 > 462 +lim sup IlYn = Weis 


m,n—oco 


2 + [ln — Yor|? 


i.e. limsupy, noo ||Yn — Yml|? = 0. Therefore {y,,}7°_, is Cauchy and hence conver- 
gent. Because M is closed, y:= lim y, € M. Also 
n—oco 


lc — y|| = lim |x — y, || = lim 6, =6 =d(a, M) 
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and therefore y is a desired closest element in M to x. 
To show that y is unique, suppose that z € M were another point such that 
||jc — z|| = 6 = d(x, M). Then using the parallelogram law as in Eq. (12.4) we find 


26? + 26? = Q\le — yl? + 2l|x — 2l|? = |]2e — (y + z)I/? + lly - al? 


(y +2) 
=Allx 5 ? + lly - zl|? 


> 46? + |ly — 2||? 


from which we learn ||y — 2||?, ie. y = 2. 
Now suppose that M is a subspace of H and y € M is the closest point in M to 
x. Then for w € M, the function 
g(t) = |x — (y + tw)|? = |la — yl? — 2tRe(x — y, w) + #?||e||? 
has a minimum at t = 0. Therefore 0 = g/(0) = —2Re(x — y,w). Since w € M is 
arbitrary, this implies that (x — y) | M. Finally suppose y € M is any point such 
that (« — y) L M. Then for z € M, by Pythagorean’s theorem, 
|e — 2||? = lle -y + y-2ll? 

= |la — yl? + lly — ll? 

> |la — yl? 
which shows d(x, M)? > ||z — y||?. That is to say y is the point in M closest to x. 
| 


Definition 12.10. Let H be a Hilbert space and M C H be a closed subspace. 
The orthogonal projection of H onto M is the function Py : H — H such that for 
x € H, Py(x) is the unique element in M such that (# — Pys(x)) L M. 


Proposition 12.11. Let H be a Hilbert space and M C H be a closed subspace. 
The orthogonal projection Py satisfies: 


1. Pyy is linear (and hence we will write Pyyx rather than Py, (2). 

2. P2, = Py (Pu is a projection.) 

3. Px, = Pu, te. (Purx,y) = (@, Puy) = (Pu, Puy) for all x,y € H. 
4. ran(Py) = M and ker(Py) = M+ 


Proof. 
1. Let 21,v72 € H andae€F, then Payyr, + aPyreq € M and 


Pyrat, + aPyrte — (21 + arg) = [Pai — 21 + a(Pyr2 — 22)| € M+ 
showing 
Pyrt, + aPyxt2g = Py (21 + ar2). 
Then Py, is linear. 
2. Obviously ran(Pyy) = M and Px =z for all z € M. Therefore P?, = Py. 
3. Let x,y € H, then since (a — Pyzx) and (y — Pyzy) are in M+, 
(Pure, y) = (Pax, Puy + y — Puy) 
= (Pux, Puy) 
= (Pux + (x — Pu), Puy) 
= (x, Puy). 
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4. It is clear that ran(Py,;) C M. Moreover, if x € M, then Pyyx = x implies 
that ran(Py) = M. Now z € ker(Py) iff Pux =0iffe =x-O€E M+. 


Corollary 12.12. Suppose that M C H is a proper closed subspace of a Hilbert 
space H, then H= MQ Mt. 


Proof. Given x € H, let y = Pyx so that x—y € M+. Then x =y+(x—-y) € 
M+M1.If2e€ MoM, then x 1 2, ie. |\2||? = (2,2) =0. So MN M+ = {0} .4 
: 


Proposition 12.13. The map 
(12.5) z€ Hs (.,2) € 
is a conjugate linear isometric isomorphism. 


Proof. The map j is conjugate linear by the axioms of the inner products. 
Moreover, for x,z € H, 


\(x,z)| < |la|| ||z|| for all a e H 


with equality when « = z. This implies that ||jz||,. = ||(-, 2) || = ||z|| . Therefore 
j is isometric and this shows that 7 is injective. To finish the proof we must show 
that j is surjective. So let f € H* which we assume with out loss of generality is 
non-zero. Then M = ker(f) — a closed proper subspace of H. Since, by Corollary 
12.12, H = M@OM-, f : H/M = M+ — F is a linear isomorphism. This 
shows that dim(M+) = 1 and hence H = M @ Fao where xq € M+ \ {0}. 
Choose z = xq € M+ such that f(xo) = (xo, 2). (So A = F(2x0)/ ||aoll? .) Then for 
x=m-+ Axo with m € M and \ € F we have 


f(x) = Af (xo) = A(z, 2) = (Az, z) = (m+ Azo, Zz) = (2, z) 
which shows that f = jz. @ 


Definition 12.14. {ua}aea C A is an orthonormal set if ua 1 ug for alla 4 8 
and ||uq|| = 1. 


Proposition 12.15 (Bessel’s Inequality). Let {ua}aca be an orthonormal set, 
then 


(12.6) S> |(z, te)? < lal)? for all x € H. 
acA 


In particular the set {a € A: (,Uq) £0} is at most countable for all x € H. 


140]1d Proof follows. 

Let P be the projection P = Py and Q be the be the complementary projection, Q = 1— P. 
It is straightforward to check that Q? = Q and PQ = QP = 0. Since for all « € H, «x = Px + Qz 
and if Px = Qy for some z, y € H, then 0 = QPx = Q?y = Qy. Therefore H = ran(P) @ ran(Q). 
Since ran(P) = M, to finish the proof it suffices to show that ran(Q) = M+. By definition of 
P, Qa =x — Px € M+ for all 2 € H so that ran(Q) C M+. Conversely, if ¢ € M+ = ker(P), 
x= (1—P)x = Qa € ran(Q). 

15 Alternatively, choose zo € M+\{0} such that f (ao) = 1. For x € M+ we have f(x—Ar0) = 0 
provided that \ := f(x). Therefore z— Axo € MN M+ = {0}, ic. x = Axo. This again shows 
that M+ is spanned by ao. 
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Proof. Let [ Cc A be any finite set. Then 


0< le — Sa, ta)ual? = lal? — 2Re Ja, ta) (tase) + > [Me ta)? 


acl acer acer 
= |la\|2 — ST |e, ua)? 
acer 
showing that 
So lest)? < lle. 
aer 
Taking the supremum of this equation of [ CC A then proves Eq. (12.6). m 
Proposition 12.16. Suppose A C H is an orthogonal set. Then s = Do,c,4v 


exists in H iff <4 |u|? < 00. (In particular A must be at most a countable set.) 
Moreover, if Sy ,<,4 ||v|l? < 00, then 


2 2 
1. [Isl = Lees llvll” and 
DASE Se gh a for all ae. i, 


CO 
Similarly if {Un}e1 be an orthogonal set, then s = ‘> vy, exists in H iff 
CO CO oS 
S> |lun||? < oo. In particular if S> vp exists, then it is independent of rearrange- 
n= n=1 
ments of {tm }o21. 


Proof. Suppose s = 5°... v exists. Then there exists I CC A such that 


Dole? =|[Soe 


ven veA 


2 
24 


for all A cc A\T ,wherein the first inequality we have used Pythagorean’s theorem. 
Taking the supremum over such A shows that >7,¢ 4\p \|u||? < 1 and therefore 


Yo Mell? <1+ D5 lel? < cv. 
veEA vel 


Conversely, suppose that )7,.< 4 ||v||? < 00. Then for all € > 0 there exists T, Cc A 
such that if Acc A\T\, 


2 


= SS |||? < é. 


ved 


Sov 


ven 


Hence by Lemma 10.28, $7.4 u exists. 
For item 1, let s.:= )),ep, v, then 


IIlsll — Ilselll S Ils — sell <€ 


and 


0< S- lull? - IIsel? < e. 


veEA 


Letting « + 0 we deduce from the previous two equations that ||s||? = eed lel 
Item 2. is a special case of Lemma 10.23. 
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N 
For the final assertion, let sy = S~ vu, and suppose that limy_.o Sy = s exists 
n=1 


in H. Then in particular {sj }\_, is Cauchy so for N > M. 
N 
s- \lvn||? = ls — sac||? ~ 0 as M,N > co 
n=M+1 
CO CO 
which shows that 57> ||v;||? is convergent, i.e. 57> ||un||? <0co. m 
n= n= 


Corollary 12.17. Suppose H is a Hilbert space, 3 C H is an orthonormal set and 
M =span 2. Then 


(12.7) Py = So (z,u)u, 
ues 


(12.8) Y-|(x,u)/? = ||Paca|? and 
ues 


(12.9) S > (x, u)(u,y) = (Pare, y) 


ues 
for all x,y € H. 


Proof. By Bessel’s inequality, }7.,¢g l(a, u)|? < |Jal|? for all « € H and hence 
by Proposition 12.15, Px := Duce lt, uu exists in H for all x € H and 


(12.10) (Px,y) = S-((z,u)u,y) = Sx, u)(u,y) 
ucB Uuep 

for all y € H. Taking y € @ in this expression shows that (Pzx,y) = (x,y), ie. 
that (x — Pzx,y) = 0. Since y € (3 is arbitrary, we learn that (x — Px) | span 6 
and by continuity we also have (x — Px) | M = span @. Since Pz is also in M, it 
follows from the definition of Py, that Px = Pyyx proving Eq. (12.7). Equations 
(12.8) and (12.9) now follow from (12.10), Proposition 12.16 and the fact that 
(Pyz,y) = (Pyx, Puy) for all x,y € H. For example, 


(Pyuz,y) = (Puz, Puy) = (So (2, u)u, Pury) = So (z,u)(u, Pury) 
ues Ue 


= S-(2,u)(Paru,y) = S“(a,u)(u,y). 


ucB UE 


| 
12.1. Hilbert Space Basis. 


Definition 12.18 (Basis). Let H be a Hilbert space. A basis ( of H is a maximal 
orthonormal subset @ C H. 


Proposition 12.19. Every Hilbert space has an orthonormal basis. 


Proof. Let F be the collection of all orthonormal subsets of H ordered by 
inclusion. If ® C F is linearly ordered then U® is an upper bound. By Zorn’s 
Lemma there exists a maximal element G€ F. m@ 

An orthonormal set 3 C H is said to be complete if 6+ = {0}. That is to say 
if (x,u) =0 for all u € 6 then x =0. 


Remark 12.20. An orthonormal set 3 C H is a basis iff 3 is complete. 
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Proof. Suppose that @ C H. If @ is not complete, then there exists a unit vector 
x € G+ \ {0}. The set U {x} is an orthonormal set properly containing 3, so 3 
is not maximal. Conversely, if @ is not maximal, there exists an orthonormal set 
G, C H such that 6 & (@,. Then if x € (, \ B, we have (x,u) = 0 for all u € 8 
showing (3 is not complete. 


Theorem 12.21. Let G C A be an orthonormal set. Then the following are equiv- 
alent: 


1. G is complete or equivalently a basis. 


2.¢= )° (a,u)u for alla € H. 
ues 


3. («,y) = YS (w,u) (u,y) for all 2,y € H. 
ues 
A. ||z|? = >> |(x,u)? for all x € H. 
ueB 


Proof. Let M = span @ and P = Py. 
(1) > (2) By Corollary 12.17, S> (x,u)u = Pyyx. Therefore 
ues 
a— (a, u)u =a Pyx € M+ = 6+ = {0}. 
ues 


(2) = (3) is a consequence of Proposition 12.16. 

(3) = (4) is obvious, just take y = x. 

(4) = (1) If x € @, then by 4), ||z|| = 0, ie. x = 0. This shows that ( is 
maximal. m 


Proposition 12.22. A Hilbert space H is separable iff H has a countable orthonor- 
mal basis 3 C H. Moreover, if H is separable, all orthonormal bases of H are 
countable. 


Proof. Let D Cc H be a countable dense set D = {u,}°@,. By Gram-Schmidt 
process there exists G = {v,}°2, an orthonormal set such that span{vy, : 2 = 
1,2...,N}D span{u, :n=1,2...,N}. So if (x, v,) =0 for all n then (x, u,) =0 
for all n. Since I) C H is dense we may choose {w,} C D such that x = limp. We 
and therefore (2, 2) = limp_..(x, wy) = 0. That is to say x = 0 and @ is complete. 

Conversely if 3 C H is a countable orthonormal basis, then the countable set 


D= So aut : Qu € Q+ iQ: #{u: ay ZO} < 00 


ues 


is dense in H. 
Finally let 6 = {u,}P2, be an basis and 6, C H be another orthonormal basis. 
Then the sets 


Ay = {uv € By : (U, Un) F O} 
are countable for each n € N and hence B := (J) An is a countable subset of A. 


n=1 
The proof will be finished by showing B is complete and hence maximal, so that 
A= B. To see that B is complete, suppose that 2 € B+ and there exists v € A\ B, 
so (Un, v) =0 for all n € N. Then 


(a,v) = So (2, tn) (uns v) =0. 


n=1 
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Since by assumption (x, v) = 0 for all v € B, it follows that (x,v) = 0 for allu Ee A 
and because A is complete, 7 = 0. m 


Remark 12.23. Suppose that {u,}?2, is a total subset of H, ie. span{u,,} = H 
Let {v,,}°2, be the vectors found by performing Gram-Schmidt on the set {u,, }?2; 
Then {v,,}°2, is an orthonormal basis for H. 


Example 12.24. 1. H = L?([—7,7],dm), then by the Stone-Weierstrass the- 
orem, {e'"°}%° __ is total and therefore e,(@) = oa for n € Z is an 
orthonormal basis. Indeed, we may identify H with L?(S',d0) by the map, 
f ¢ H = (@— f(e®)) € L?(S",d0). Under this identification, e’ corre- 
sponds to 2” and we have seen by the Stone-Weierstrass theorem that the 
algebra generated by z and z~! is dense in O(S1). Since C(S") is dense in 
L?(S',d0), it follows that the algebra generated by z and z~! is dense in 
L?(S',d0) as well. 

2. Let H = L7({-1,1],dm) and A:= {1,2z,27,23...}. Then A is total in H by 
the Sane: Weierstrass theorem and a similar atouiment as in the first example. 
The result of doing Gram-Schmidt on this set is the Legendre Polynomials. 

3. Let H = [7(R, e- 2” da). Fact A := {1,z,27,2°...} is total in H and the 
result of doing Gram-Schmidt on A now gives ‘ihe: Hermite Polynomials. 


—oo 


Hernan 12. - (An Interesting Phenomena). Let H = L?({[-1,1],dm) and B : 
{1,2?,2°,2°,...}. Then again A is total in H by the same Seaument as in item 9, 
Reape 12. 24. This is true even though B is a proper subset of A. Notice that A 
is an algebraic basis for the polynomials on [—1,1] while B is not! The following 
computations may help relieve some of the reader’s anxiety. Let f € L?({—1, 1], dm), 
then, making the change of variables x = y!/*, shows that 


gan) f ; Fo Pae = f ; Lo) gu Pay = [ ; lFu’)| u(y) 


where du(y) = $y7?/3dy. Since p([-1, 1]) = Hee 1]) = 2, pw is a finite measure 
on [—1, 1] and hence regular and hence C({-1, 1]) is dense in L?({—1 i, dpi). Thus 
the ‘astal Stone Weierstrass argument shows as above that A:= {1,2,2?,a?...} is 
a total in L?({—1,1],du). In particular for any € > 0 there exists a pOlanomusl p(y) 
such that 


iB Ficuae ~ p(y)|- duly) < é. 


However, by Eq. (12.11) we have 
1 
2 
2> [ra -reof ay = f° [se -r@)P ae. 
-1 


Alternatively, if f € C([-1,1]), then g(y) = f(y'/) is back in C([-1, 1]). There- 
fore for any € > 0, there exists a polynomial p(y) such that 


e> |lg— pil. = sup {lo(y) — p@)|=¥ € [-1, 1] 
= sup {|g(x*) — p(x*)| : x € [-1, 1]} = sup {| f(x) — p(x*)| : « € [-1,1]}. 


3 


This gives another proof the polynomials in x° are dense in C({[—1,1]) and hence 


in L?({-1,1)). 
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12.1.1. Non-complete inner product spaces. Part of Theorem 12.21 goes through 
when H is a not necessarily complete inner product space. We have the following 
proposition. 


Proposition 12.26. Let (H,(-,-)) be a not necessarily complete inner product 
space and 3 C H be an orthonormal set. Then the following two conditions are 
equivalent: 


Theorem 12.27. 1. © = S¢ (a, u)u for all x € H. 
ueB 
2. ||al|? = >> |(x,u)|? for all z € H. 
ues 
Moreover, either of these two conditions implies that 3 C H is a maximal or- 


thonormal set. However 3 C H being a maximal orthonormal set is not sufficient 
to conditions for 1) and 2) hold! 


Proof. As in the proof of Theorem 12.21, 1) implies 2). For 2) implies 1) let 
A CC £ and consider 


x So (a, uu 


ucA 


2 
= lle? 2 7 Ke, uP? + [Meu P 


UucAr ued 


= lle? — So Ke, u)P 


ued 


Since ||z||? = S> |(z,u)|?, it follows that for every € > 0 there exists Ae CC 3 such 
ues 
that for all A cc G such that A, Cc A, 


2 


= all? — SO (ea? 


uEA 


showing that x = S° (x, u)u. 
ues 

Suppose x € (3+. If 2) is valid then ||z||? = 0, ie. 2 = 0. So @ is maximal. Let 
us now construct a counter example to prove the last assertion. 

Take H = Span{e;}9, C @ and let &, = e1—(n+1)en41 forn = 1,2.... Apply- 
ing Gramn-Schmidt to {t,,}°°_, we construct an orthonormal set 3 = {un}°, C H. 
I now claim that 6 C H is maximal. Indeed if x € G+ then x L uy, for all n which 
then implies that for all n € N, 


0 = (2, tn) = 4 — (n+ Leni. 


Therefore p41 = (n+ i x1 for all n. Since x € Span{e;}2,, xy = 0 for some N 
sufficiently large and therefore x, = 0 which in turn implies that x, = 0 for all n. So 
x =O and hence 3 is maximal in H. On the other hand, ( is not maximal in @, sine 
the above argument shows that 3+ in (7 is given is the span of v = (1, s, z + i, hee) 


Let P be the orthogonal projection of (? onto Span3 = vt. Then 


CO 


So (2, tin)Un = Px, 


t=1 


66 BRUCE K. DRIVER 


so that 5+ (x, Un)tn = x iff x € SpanG = vt Cc @. For example if z = (1,0,0,...) € 
i=l 
H or x =; for any i, then x ¢ vt and hence 


CO 


Fest htin 2 
i=l 
a 
12.2. Appendix: Converse of the Parallelogram Law. 


Proposition 12.28 (Parallelogram Law Converse). If (X,||-||) is @ normed space 
such that Eq. (12.2) holds for all x,y € X, then there exists a unique inner product 


on (-,-) such that |\a|| := \/(x,2) for all x € X. In this case we say that ||-|| is a 
Hilbertian norm. 


Proof. If ||-|| is going to come from an inner product (-,-), it follows from Eq. 
(12.1) that 


2Re(x,y) = lla + yl? — lal? — [lyll? 
and 
—2Re(z,y) = |x — yll? —|lel? — llyll?. 
Subtracting these two equations gives the “polarization identity,” 
4Re(x,y) = || + yl? — || — yl’. 
Replacing y by zy in this equation then implies that 
Atm(x,y) = || + éyl|? — lla — éyl|? 


from which we find 


1 2 
(12.12) (ey) = 7 > elle + ell 
€€G 
where G = {+1,+i} —a cyclic subgroup of S' C C. Hence if (-,-) is going to exists 


we must define it by Eq. (12.12). 
Notice that 


1 : . : . 
(x,) =) \ ella + ex? = |[a|)? + alle + éa||? — alle — ee? 
e€G 


: F : p 2 
= [ol +41 + 4?| lle? —4]1 — 4] [I21/? = ||". 


So to finish the proof of (4) we must show that (x,y) in Eq. (12.12) is an inner 
product. Since 


4(y,«) = Selly + ex? = 5 elle(y + €2) |? 


e€G €€G 

= So eleyt+ Pa? 

e€G 

= |ly + 2|/? + || —y + 2|/? + 4alliy — x||? — ¢|| — ey - ||? 


= |e + ylP + lle — yl? + alla — ay? — alla + yl? 
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it suffices to show that « — (x,y) is linear for all y € H. (The rest of this proof 
may safely be skipped by the reader.) For this we will need to derive an identity 
from Eq. (12.2). To do this we make use of Eq. (12.2) three times to find 


al? + alla + yl? + 2llzII? 


la +y +2]? =-lle+y 
= |la — y — 2|? — 2||a — 2|/? — 2\yl]? + Ql] + yll? + 2llzl|? 
= |ly + z— all? — 2|la — 2|/? — 2QKyl]? + Ql] + yll? + 2\lzl|? 
= —|ly + 2+ |? + 2lly + 2]? + 2llal|? — 2l|a — z\|? — Qllyll? + lla + yl? + 2llz|l?. 


Solving this equation for | 


r+y+2\|? gives 


(12.13) ja +y + 2|)? = lly + 2ll? + [lz + yl? — lle — 2\)? + [lel + [lz|? — Ilyl?. 
Using Eq. (12.13), for x,y,z € H, 
4Re(x + 2,y) = ||et2+yll? — le +2— yl? 
= lly + 2\[? + lle + yl? — lle — 2|]? + llel? + ell? — Ilyll? 
(lz — yl? + l]@ — yl? — lle — 2)? + llell? + [lell? — [lll?) 
= lz + yl? — llz — yl? + lle + yl? - lle — yl? 


(12.14) 


= 4Re(a,y) + 4Re(z, y). 


Now suppose that 6 € G, then since |é6| = 1, 


1 
(62,9) = 3 > dlée- 


(12.15) 


e€G 


€€G 


€€G 


1 
= 7 Alle + deyl? = 46(0,0) 


1 = 
Feyl? = 5 do ella + or tey 


where in the third inequality, the substitution ¢ — €6 was made in the sum. Since 


Im(x,y) = Re(—ia, y) 
it follows from Eq. (12.14) and (12.15) that 
4Im(a + z,y) = 4Re(—iax — iz,y) = 4Re(—ia, y) + 4Re(—iz, y) 
= 4Im(z, y) + 4Im(z, y) 
which combined with Eq. (12.14) shows 
(x + 2,4) = (@,y) + (2,9). 


Because of this equation and Eq. (12.15) to finish the proof that x — (x,y) is 
linear, it suffices to show (Az, y) = A(x, y) for all A > 0. Now if A= m EN, then 


so that by induction (mz,y) = m(az,y). Replacing x by x/m then shows that 
(x,y) = m(m-'z,y) so that (m-!x, y) = m7"(zx,y) and so if n € N we find 


(22, y) =n(—2,9) = 7 (2,9) 


so that (Az,y) = A(z,y) for all \ > 0 and A € Q. By continuity, it now follows 
that (Az,y) = A(z,y) for all X > 0. (Question, could this have been carried out 


algebraically?) ™ 
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12.3. Appendix: Proofs via orthonormal bases. In this appendix, let us give 
some proofs of the previous theorems making use of that fact that every Hilbert 
space has an orthonormal basis. (This appendix may safely be skipped.) As above, 
let H be a Hilbert space. 

Let G6 C H be an orthonormal set and M = span @ C H. Then M is a closed 
subspace of H and hence a Hilbert space. (Moreover 3 C M is an orthonormal basis 


for M since if  € 3+ then x € span Ba = M-. Therefore if x € M and zx € +, 
then « = 0.) For « € H, let Px = Y° (x,u)u then P : H — GH is orthogonal 


ues 
projection of H onto M. Indeed, if y= Px = S~ (a, u)u, then for v € 6, 
ues 
(x = Y; U) = (x, v) ¥S So (z,u)(u,v) = (x, v) — (2,0) =0 
ues 


showing «—y € G+ = M+. Soifme M, 
lle — ml? = [(@ — y) +y — ml)? = |x — yl? + [ly — mI? > |e — yIP 


with equality iff m = y which shows that y is the unique element in M minimizing 
the distance of x to M. 
Let us also show using an orthonormal basis that the map 


H — H* 
zr (., 2) =e, 
is a conjugate linear isometric isomorphism. First off by the Schwarz’s inequality, 


I|f|| = sup |éx(y)| = sup |(x,¥)] < |lar). 
lvll=1 lvll=1 


Moreover taking y = x/||z||, |e (y)| = ||a|| showing that ||¢.|| > ||a|| and therefore 
that ||é,.|| = |||]. So « — @, is an isometric map which is easily seen to be conjugate 
linear. Hence we need only show that to every f € H* \ {0} there exists x € H 
such that f = ¢, = (-,x). Let 6 C H be an orthonormal basis for H, then if x is 
going to exist we would have 


(12.16) r= So (z,u)u = > f(u)u. 


ues Ue 


In order to make use of this formula, we need to show }7.,<3|f (u)|? < oo. Suppose 
that A CC 6 and y € Span, then 


fy) =fOl&. we = yw Fw =, >> Fu). 


ued ued wcA 


Taking y = ea f(u)u in this expression then shows that 


2 
f(y) = lly = lly lyll 
showing ||y||;, < ||f||,~. . Squaring this inequality then shows that 


S~ fl)? = lulz, < IIFIR < 00 


ued 
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and since A CC ( is arbitrary, it follows that )7_.< |f (u)|? < 00 as desired. There- 
fore we may define x by Eq. (12.16). Then for y € H, 


fu=fl wee] =>oewf@ =S0, Feu) =u, d5 Fwu) = y,2). 


ue ue ue ues 


13. BAIRE CATEGORY THEOREM AND ITS CONSEQUENCES 
Recall that a set E is said to be nowhere dense iff (£)° =), i.e. E has empty 
interior. Also notice that EF is nowhere dense is equivalent to 
X = ((B)’)' = (B)° = (9. 
That is to say E is nowhere dense iff E° has dense interior. 
13.1. Baire Category Theorem. 
Theorem 13.1 (Baire Category Theorem). Let (X,p) be a complete metric space. 
1. If {Vr}, is a sequence of dense open sets, then G:= q V, is dense in X. 
2. If {En} 7, is a sequence of nowhere dense sets, then Xe a Ee 


Proof. 1) We must shows that G = X which is equivalent to showing that 
WG #9 for all non-empty open sets W Cc X. Since V; is dense, WN V,; #0 and 
hence there exists x; € X and €; > 0 such that 


B(x1,€1) ie Woy. 


Since V2 is dense, B(a1,€1) V2 4 0 and hence there exists rz € X and €2 > 0 such 
that 


B(x2,€2) C B(a1,4) Va. 
Continuing this way inductively, we may choose {z,, € X and €,, > i adie such that 
B(@n;€n) C B(@n—1, €n—1) M Vn Vn. 


Furthermore we can clearly do this construction in such a way that e, | 0 as 
n 7 co. Hence {x,,}°2, is Cauchy sequence and « = lim 2, exists in X since X 


is complete. Since B(zp,€,) is closed, x € B(an,€,) C Vz so that x € V,, for all 
n and hence x € G. Moreover, x € B(x1,41) C WMV, implies x € W and hence 
x€WNG showin WNGF9O. 

2) For the second assertion, since UO, En C US2, En, it suffices to shows that 
X # US, Ey or equivalently that 0 4 (VP, (En)° = 1%, (ES)°. As we have 
observed, E,, is nowhere dense is equivalent to (E¢)° being a dense open set, hence 
by part 1), (\72, (ES)° is dense in X and hence not empty. 


Definition 13.2. A subset E C X is meager or of the first category if E = 
U EE, where each E,, is nowhere dense. And a set F' C X is called residual if F° 


n=l 
1s meager. 


Remarks 13.3. The reader should think of meager as being the topological analogue 
of sets of measure 0 and residual as being the topological analogue of sets of full 
measure. 
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1. If F is a residual set, then there exists nowhere dense sets { £,,} such that 
funy cea Sie ea O niga Pe 
Taking complements of this equation shows that 
gauge 


i.e. F contains a set of the form N°2,V, with each V,, being an open dense 
subset of X. 
Conversely, if N°2,Vn C F with each V,, being an open dense subset of 

X, then F° C U,V," and hence F° = URL, En, where E, = FSO VY, a 
nowhere dense subset of X. Therefore F is residual iff F' contains a countable 
intersection of dense open sets. 

2. A countable union of meager sets is meager and a subsets of a meager set is 
meager. 

3. A countable intersection of residual sets is residual. 


The Baire Category Theorem may be stated as follows. If X is a complete metric 
space, then (1) all residual sets are dense in X and 2) X is not meager. 


13.2. Application to Banach Spaces. 


Theorem 13.4 (Open Mapping Theorem). Let X,Y be Banach spaces, T € 
L(X,Y). If T is surjective then T is an open mapping. 


Proof. For all a > 0 let By = {mE X:||2||y <a} C X, Ey = T(Ba) and 
B(0,a) = {y €¥: |lylly <a}. _ 

Claim 1. For all a > 0 there exists 6 >0 such that B(0,6) C Ey. 

Since Y = Ej, the Baire category theorem implies there exists n such that 


n—-1 
E. # i), ie. there exists y € E, and € > 0 such that B(y,e) C En. Suppose 


\|y’|| < € then y and y+y’ are in B(y,e) C Ep hence there exists 2’,2 € B, such 
that ||Tx’ — (y+ y’)|| and ||T'x — y|] may be made as small as we please, which we 
abbreviate as follows 


Ta! — (y+ y')|| © 0 and ||Tx — yl| ~ 0. 
Hence by the triangle inequality, 


Far ay Sa |= [Pel — (phy) — (Pa y)|| 
< ||Tx’— (yty’)|| + [Ta — yl] +0 


with x’ — x € By,. This shows that y’ € Ey, which implies B(0,¢) C E2,. Since 
the map ¢. : Y > Y given by ¢a(y) = sy is a homeomorphism, ¢o(Fon) = Ea 
and ¢(B(0,€)) = B(0, $£), it follows that B(0,6) C E, where 6 = $< > 0. 

Claim 2. There exists € >0 such that B(0,¢) C Ej, i.e. Claim 1. holds with 
out the closure. 

By Claim 1, there exists 6 > 0 such that B(0,5) C E,. As in the proof of 
Claim 1. we also have B(0,a6) C Eq for all a > 0. Now let ¢€ := 6/2 andy € Y 
be such that |ly|| < ¢ = 6/2. Then y € B(0,56) C Ey so there exists There 


exists 2; € By/2 such ||Tx, — y|| ~ 0 and in particular we may assume that 


ly — Tx1|| < 2-'e = 6/4 = 2°76. 
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Similarly, y — Tx, € B(0, 46) Cc Ei implies there exists zz € By/4 such that 
ly — T21 — Tze|| < 2-7e = 2-36 
and hence an x3 € Bpg-s such that 
lly — Try —Tx2 — Tx3|| < 2-3¢ = 2746. 
So by induction, we find x, € Bg-n such that 


(13.1) ly— So Tzell = lly - Tar — Ta —----Taal| <2 = 2°46, 
k=1 
Since 


= A f1\" 1 1 
dilel<2:(5) =2(r=3)-4 
r= SS Ly, exists and ||z|| < 1. Passing to the limit in Eq. (13.1) shows, ||y—T || = 


0. Thus we have shown if ||y|| < ¢ then y € T(B,) = E, which is the content of 
Claim 2. 

We now show that T is open. If xe V Cc, X andy =Tx € TV we must show 
that TV contains a ball B(y,6) for some 6 > 0. Now the following statements are 
easily seen to be equivalent: 

Bly, 6) = B(Tx,6) CTV 

B(0,6) CTV —Tx =T(V — 2) 
(13.2) B(0,a6) c T[a(V — z)| 
for some a > 0. But since V — z is a neighborhood of 0, there exists a > 0 such 
that By C a(V — x) and hence by Claim 2. there exists an € > 0 such that 

B(0,e) CTBy Ca(V — 2). 

Therefore we see that Eq. (13.2) holds provided we choose 6 = e/a >0. 
Corollary 13.5. If X,Y are Banach spaces and T € L(X,Y) is invertible (i.e. a 


bijective linear transformation) then the inverse map, T~', is bounded, i.e. T~' € 
L(Y, X). (Note that T—! is automatically linear.) 


Theorem 13.6 (Closed Graph Theorem). Let X and Y be Banach space T : X > 
Y linear is continuous iff T is closed i.e. T(T) C X x Y is closed. 


Proof. If T continuous and (%,,Tzn) — (%,y) € X x Y as n > oo then 
Tx, — Tx = y which implies (x, y) = (x, Tx) € T(T). 
Conversely: If Tis closed then the following diagram commutes 


where ['(z) := (2, Tz). 
The map 72 : X x Y — X is continuous and 7|p(7) : '(T) > X is continuous 
bijection which implies mIPcr) is bounded by the open mapping Theorem 13.4. 
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Hence T = 79 0 ™lF(r) is bounded, being the composition of bounded operators. 
rT] 
As an application we have the following proposition. 


Proposition 13.7. Let H be a Hilbert space. Suppose that T: H — H is a linear 
(not necessarily bounded) map such that there exists T* : H — H such that 


(Tz, Y) =(2,T*Y)Va,ye H. 
Then T is bounded. 


Proof. It suffices to show that T is closed. To prove this suppose that x, € H 
such that (t,,T2n) > (x,y) € H x H. Then for any z € H, 


(T2n,z) = (&p,T*z) —> (2,T*z) = (T2,z) asn— oo. 


On the other hand limp—.o(T¢n, z) = (y,z) as well and therefore (Tx, z) = (y, z) 
for all z € H. This shows that Tx = y and proves that T is closed. m™ 
Here is another example. 


Example 13.8. Suppose that M Cc L?({0,1],m) is a closed subspace such that 
each element of M has a representative in C'([0,1]). We will abuse notation and 
simply write M Cc C((0,1]). Then 

1. There exists A € (0,00) such that ||f|. < Al|f||z2 for all f ¢ M. 


2. For all x € [0,1] there exists g, € M such that 


Moreover we have ||g..|| << A. 
3. The subspace M is finite dimensional and dim(M) < A?. 


Proof. 1) I will give a two proofs of part 1. Each proof requires that we first 
show that (M, || - ||.) is a complete space. To prove this it suffices to shows that 
M is a closed subspace of C((0,1]). So let {fn} C M and f € C((0,1]) such that 
Fre =F lle > OAs 1. > Coz Then: || fF, = frl| pe || fr — Frall,, — 0 asm we — 09, 
and since M is closed in L?({0,1]), L? — limp fn = g € M. By passing to a 
subsequence if necessary we know that g g(x) = limp... fn(x) = f(x) for m - ae. 
x.Sof=gEM. 

i)Let i: (M, || + |lu) ~ (M, || - |l2) be the identity map. Then i is bounded and 
bijective. By the open mapping theorem, j = i~! is bounded as well. Hence there 
exists A < oo such that || f||,, = ||7(f)|| < Allfll, for all f eM. 

ii) Let 7 : (M,||- |l2) ~ (M, || - ||) be the identity map. We will shows that j is 
a closed operator and hence bounded by the closed graph theorem. Suppose that 
fn € M such that f, — f in L? and fy, = j(fn) — g in C((0,1]). Then as in the 
first paragraph, we conclude that g = f = j(f) a.e. showing j is closed. Now finish 
as in last line of proof i). 

2) For x € [0,1], let ex : M — C be the evaluation map e,(f) = f(x). Then 


leo(f)| S 1F(@)| S IIfllu < Allfllz2 


which shows that e, € M*. Hence there exists a unique element g, € M* such 
that 


f(z) = ex(f) =(f, 9) for all f € M. 


Moreover ||gx||z2 = ||ex|| a < A. 


MATH 240B LECTURE NOTES: TOPOLOGY AND FUNCTIONAL ANALYSIS 73 


3) Let {fj }%_, be an orthonormal subset of M. Then 
A? > |lecllAa = Igellz2 > SOM fi,92)1? = So 1f (2)? 
j=l j=l 


and integrating this equation over x € [0,1] implies that 


n i n 
>>> | i (@)Pde= Soin 
j=1 j=l 


which shows that n < A?. Hence dim(M) < A?. 
Remark 13.9. Keeping the notation in Example 13.8, G(x, y) = gx(y) for all x,y € 
(0, 1]. Then 


1 
Fle) =ex(t) = f(y) Ce a}dy for all f <M. 
The function G is called the reproducing kernel for M. 


The above example generalizes as follows. 


Proposition 13.10. Suppose that (X,M, 1s) is a finite measure space, p € [1, 00) 
and W is a closed subspace of L? (js) such that W Cc L?(w)NL© (yu). Then dim(W) < 
00. 


Proof. With out loss of generality we may assume that (X) = 1. As in Example 
13.8, we shows that W is a closed subspace of L°°(j) and hence by the open mapping 
theorem, there exists a constant A < oo such that ||f||,, < A||f||, for all f ¢ W. 
Now if 1 < p< 2, then 


IIflloo S Alfll, < Allflle 


and if p € (2,00), then || f||> < | FS F257 or equivalently, 


2, 1-2/p 
Illy < Fila’? sll 2/” < IIR” (AIFllp) 


from which we learn that ||f\|, < A'—?/P || f||, and therefore that ||f||,, < 


AA!-?/ || f\|, so that in any case there exists a constant B < oo such that 
IIflloo S Bllflle- 

Let {fn ae be an orthonormal subset of W and f = eae Cnfn with c, € C, 
then 


N 
< BO lenl? < Bel? 


2 
oo n=1 


N 
Saas 
n=1 


where |c|” := yan lcn| . For each c € C%, there is an exception set E, such that 
for « ¢ Eo, 


2 
< B? |¢|. 


N 
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Let = (Q+iQ)” and E = MeepE-. Then p(E) = 0 and for x ¢ E, 
year Cn f(z) < B? Ic? for all c € D. By continuity it then follows for x ¢ E 
that 


2 
< B?|c|* for allce CN. 


N 
Cnn (x) 


Taking c, = f(x) in this inequality implies that 


S- | fn(2)I? 


2 N 
<Be S> lfn(x)|? for alla ¢ E 
n=1 


and therefore that 
N 
S- \fn(x) |? < B? for all x ¢ E. 
n=1 


Integrating this equation over x then implies that N < B?, i.e. dim(W) < B?. = 


Theorem 13.11 (Uniform Boundedness Principle). Let X and Y be a normed 
vector spaces. Suppose A Cc L(X,Y) and let 


(13.3) R=Ra:= {xe X: sup ||Az|| = co}. 
ACA 


Then sup ||A|| < co iff R is not residual. In particular if X is a Banach space and 
AE 


sup ||Az|| < oo for all x € X then sup ||A|| < co. 
AEA AEA 


Proof. If M := sup ||Al| < oo, then sup ||Az|| < © ||z|| < co for all  € X, so 
AEA AEA 


that R = and R is not residual. Conversely, if R is not residual, then R° = {x € 
X : sup ||Az|| < oo} is not meager. For each n € N, let E, C X be the closed sets 
AEA 


given by 
E,, = {x: sup ||Az|| <n} = () {x : ||Az|] < n}. 
AEA ACA 
Then R° = UP, E, and since R° is not meager, there exists an n € N such that 
E® #0. Let B(x, 6) be a ball such that B(x,6) C En. Then for y € X with ||y|] = 6 


we know x — y € B(z,6) C Ey, so that Ay = Ax — A(x — y) and hence for any 
AEA, 


|| Ayl] < || Axl] + || A@ — y)I| Sn +n = 2n. 
Hence it follows that ||A|| < 2n/6 for all A € A, ie. sup ||Al| < 2n/6 < co. 
If sup ||Az|] < oo, then R=. If X isa Bilseh opacd then residual sets are 
deeds a hence R = #) is not a Residual set. Therefore sup ||A|| < oo by the first 
part of the Theorem. oe 


Example 13.12. Suppose that {c,}°°_, C C is a sequence of numbers such that 
N 

lim S> nCp, exists in C for all a € £1. 
n=1 


N-oo 


Then cE £%. 
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Proof. Let fy € (" be given by fy(a) = Ney QnCyn, and set My := 
max {|c,|:2=1,...,N}. Then 


| fv(@)| < My |lalle 


and by taking a = ex, with k such My = |cx|, we learn that || fn|| = Wn. Now by 
assumption, limy_.oo f(a) exists for all a € ¢' and in particular, 


sup | fn (a)| < oo for alla € ¢'. 
N 


So by the Theorem 13.11, 
oo > sup || fiv|| = sup My = sup {|cp| sn = 1,2,3,...}. 
N N 
| 


13.3. Applications to Fourier Series. Let T = $' be the unit circle in S$! and m 
denote the normalized arc length measure on T. So if f : T — [0, 00) is measurable, 


then 
[ tw yaw = [fami ae Rica 


Also let $;,(z) = 2” for all n € Z. Recall that {¢, ve is an orthonormal basis for 
[?(T). For n € N let 


Sie) a= 3 (f, on) bk (Z) = 3 (‘hen2 = oe Oe: f(w )ahaw) 2! 


k=—n k=—n a 
=/ f(w) ( S> os) dw =a f (w)dp (z@)dw 
T k=—n 
where d,(a) := )>;__,, a*. Now adn (a) — dy (a) = a"t! — a7", so that 
n qnt1 —aq-” 
d = Re 
n(or) De, : a-—l1 
k=—n 
with the convention that 
qrtl —aq- : qrtl —~aqn n ‘ 


Writing a = e”, we find 
iO(n+1) _ ,—ion i0(n+1/2) _ ,—i0(n+1/2) 
Dey sage = Se 
ef — 1 e9/2 — e—10/2 
_ sin(n + 5)0 


sin 0 
Recall by Hilbert space theory, L?(T) — limp—.oo 8n(f,-) = f for all f € L?(T). We 
will now show that the convergence is not pointwise for all f € C(T) c L?(T). 


Proposition 13.13. h z € T, there exists a residual set R, C C(T) such that 
sup,, |8n(f,z)| = co for all f € R,. Recall that C(T) is a complete metric space, 
hence R, is a dense subset of C(T). 
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Proof. By symmetry considerations, it suffices to take z= 1€T. Let A, f := 
8n(f,1). Then 


Jnl =| [ teeyanca nau < [\slewrda()| dee <I f Jd) de 


showing 
[ball < fda (@)| aw 


Since O(T) is dense in L'(T), there exists f;, € C(T,R) such that f,(w) — sgnd;(w) 
in L'. By replacing f, by (fg A 1) V (—1) we may assume that || fx||,, < 1. It now 


follows that 
A 
an > Bettl > 1f p.ceydn Code 
\| Faclls T 


and passing to the limit as k — oo implies that ||A,|| > [7 |dn(@)| dw. Hence we 
have shown that 


(13.4) ||Anll= | |dn( dw = = (e~)| dd = 
34) [Anll =f Idn(w)|aw= 5 f |dgle®)| d= = fo 


Since 


sin(n + 5)0 


1 
sin 50 


| dé. 


M0 x 
sinz = | cos ydy < \cos y| dy < a 
0 0 


for all x > 0. Since sin x is even, |sinz| < |z| for all x € R. Using this in Eq. (13.4) 
implies that 


1 /7 |sin(n+4)@ oe 1, ,| dé 
> 2 = ie 
\|An|| > an a T% ao =| sin(n + 4 9 
= =| sin(n + 54 a 
Since 
7 (n+3) 
sin(n + —)0 ey - ig eee a, 
) 2 0 0 y 


we learn that sup,, ||An|| = co. So by Theorem 13.11, 
Ry ={f €C(T) : sup|Anf| = 00} 


is a residual set. @ 
See Rudin Chapter 5 for more details. 


Lemma 13.14. For f € L'(T), let 
f(n) = (fbn) = [ f(w) ao" dw. 


Then f € cg and the map f € L'(T) — co is a one to one bounded linear transfor- 
mation into but not onto co. 
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es suf 
Proof. By Bessel’s inequality, )7,¢z |F(n)| < oo for all f € L?(T) and in 
particular lim),)—... |F(n)| = 0. Given f € L'(T) and g € L?(T) we have 


fn) — a(n)| = 


[ tr) - ow) wu] APs, 
and hence 


lim sup | Fn = lim sup \F(n) — a(n) < ||f — all, 


nm—Cco n—-Co 


for all g € L?(T). Since L?(T) is dense in L'(T), it follows that lim sup,,_,., 
0 for all f E Li, ie. fea. 
Since |F(n)| < ||f]|, , we have || < ||f||, showing that Af := f is a bounded 
co 


fn) = 


linear transformation from L1(T) to co. 
To see that A is injective, suppose f = Af = 0, then J, f(w)p(w, w)dw = 0 for 
all polynomials p in w and w. By the Stone - Wierstrass theorem, this implies that 


| f(w)g(w)dw =0 
EY 


for all g € O(T). Since C(T) is dense in L1(T,|f(w)|dw), there exists bounded 
functions g, € C(T) such that g, — senf € L'(T,|f(w)| dw). Thus 


0= tim [ F(w)an(whdw = im. [| on(w)senf(w) f(w)| aw = f | f(w)| dew 


nm—oCo 


which shows that f = 0 a.e. 
If A were surjective, the open mapping theorem would imply that A7! : ¢ — 
L'(T) is bounded. In particular this implies there exists C < oo such that 


(13.5) fll <¢ lll. for all f € L'(T). 


Taking f = d,, we find |an 
(13.5). Therefore ran(A) # eae | 


= 1 while lim,_..0 ||dn||,1 = co contradicting Eq. 


14. L?-SPACES 


Let (X,M, 4) be a measure space and for 0 < p < co and a measurable function 
f:X — C let 


l= Cf Pay, 
When p = ov, let 
Il flloo = inf {a > 0: (| f] > a) = 0} 
For 1 < p< o, let 
D(X, M, pu) ={f:X > C: f is measurable and ||f||p < co} / ~ 


where f ~ g iff f = g ae. Notice that ||f — g||p = 0 iff f ~ g and if f ~ g then if 
f ~g then ||fIlp = ||g|lp. In general we will continue to write f for the equivalence 
class containing f. 
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Remark 14.1. We have ||fll. < M iff |f(x)| < M for w- ae. x. To see this, 
suppose that ||f|lo < M, then for all a > M, p(\f| > a) = 0 and therefore 
w(|f| > M) = limp... w(|f| > M +1/n) = 0, so that |f(x)| < M for w- ae. x. 
Conversely, if | f| << M a.e., then for a > M, u(|f| > a) =0 and hence || fl. < M. 
So in conclusion we have shown 


lfllo =inf {a >0:|f(x)| <a for w—a.e. a}. 


Our first goal in this section is to show (POM, Lt), I-ll,) is a Banach space. 
We will start with the case p = oo. 


Theorem 14.2. The function ||-||,, is a norm on L* and (L°(X,M, 1), ||-||,,) és 
a Banach space. A sequence { fn}>_, C L© converges to f € L™ iff there exists 
E €M such that p(E) = 0 and fn — f uniformly on E°. Moreover, bounded 
simple function are dense in L°. 


Proof. Suppose that f,g € L®, then |f| < ||f||,, ae. and |g| < ||g||,, ae. so 
that |f +9] < Ifl-+lgl <liflloc + lldlloo ae. and therefore 


Therefore ||-||,, satisfies the triangle inequality. The reader may easily check the 
remaining conditions that ensure ||-||,, is a norm. 
Suppose that {fn }°°., C L© is a sequence such f, > f € L™, ie. ||f — fll, > 


0 as n — oo. Then for all k € N, there exists Nz < oo such that 
“(Ff — fal Se) =0 for all n > Ng. 
Let 
E = Upea Un>ne {lf — ful > OT}. 


Then p(E) = 0 and for x € E®%, we have |f(x) — fn(x)| < k7! for all n > Ny. This 
shows that f,, — f uniformly on E°. Conversely, if there exists E € M such that 
(E£) =0 and f, — f uniformly on E£°, then for any € > 0, 


w(f—-frl> eo =H(lf — fal > ef} N EY) =0 


for all n sufficiently large. That is to say limsup,,_.., || f — fnll, < € for all e > 0. 
The density of simple functions will be left as an exercise to the reader. 
So the last thing to prove is the completeness of L°° for which we will use 


CO 


Theorem 10.3. Suppose that { f,}°-_, C L° is a sequence such that ~~, || fll, < 


oo. Let Mn := |lfrllg, En := {lfn| > Mn}, and E := UP2, E, so that u(E) = 0. 
Then for x € E° we have 


CO CO 
>_ sup |fn(x)| < S 7 Mn < 00 
n=1 xe he n=1 


which shows that Sy (a7) = ey fn(z) converges uniformly to S(x) := ~~, fn(2) 
on E°, that is to say ||S—S,||,, ~0asn— oo. & 
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14.1. Some inequalities. 


Proposition 14.3. Let f : [0,c0) — [0,c0) be a continuous strictly increasing 
function such that f(0) =0 (for simplicity) and lim f(s) = 00. Let g = f~! and 
for s,t > 0 let 


F(s)= a f(s’)ds’ and G(t) = ip g(t’) dt’. 


0 
Then for all s,t > 0, 
st < F(s) + G(t) 
and equality holds iff t = f(s). 
Proof. Let 
f(o) for0<o0<s} and 
g(r) for 0 <7 < t} 


then as one sees from Figure 4, [0,s] x [0,t] C A, U By. (In the figure: s = 3, t = 1, 
Ag is the region under t = f(s) for 0 < s < 3 and B, is the region to the right of 
the curve s = g(t) for 0 <t <1.) Hence if m is Lebesgue measure on the plane, 


st = m((0,s] x [0,t]) < m(A;) + m(Bz) = F(s) + G(t). 


Figure 4. A picture proof of Proposition 14.3. 


Definition 14.4. The conjugate exponent q € [1,00] to p € [1, oo] is g := rae with 
the convention that gq = co if p = 1. Notice that q satisfies 


1 1 
(14.1) So2 (ie ey gy" =i andep= ip 
Pp @q Pp qd 
Lemma 14.5. [f s,t >0 then 
si ¢P 
st << — + — 
qd 


with equality if and only if s4 = t?. 
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Proof. Let F(s) = = for p > I, 
f(s) =91 =t 


or 
g(t) =e = 471 
because g = 1/(p—1)+1 or 1/(p— 1) = q-—1. Therefore G(t) = ¢7/q and hence 
sP tf 
st << — + — 
Pp q 
with equality iff t = s?-!. = 


Theorem 14.6 (Hdélder’s inequality). Suppose that 1 < p < oo and q := (=27) : 


or equivalently 


If f,g are measurable functions then || fla < \|fllp- llgllq with equality iff 
If \g| 
ay =i 
If ll Ilglla 
Proof. The cases where || f||, = 0 or co or ||g||» = 0 or oo are easy to deal with 
and are left to the reader. So we will assume now that 0 < ||f\lq, ||gllp < co. Let 
s=I(fl/\lfllp and t =|g|/|lg||q then Lemma 14.5 implies 


poled IE i ge 
IIfllpliglla ~ P llflle 4 llgll¢ 
Integrating this equation then gives 


fl 1,1 


SS oh Sol 
IIflpliglla~ Pp @ 
with equality iff 
lg| dle lol _ |FIP/¢ 
=~ go ae = pq te: => lol FID = lalla\ fl? a.e. 
IIglle yi fig IIglle | FI 


| 
Theorem 14.7 (Minikowski’s Inequality). If 1< p< co and f,g € LP then 
If + gllo < Wflle + Ilgllp. 
with equality iff 
sen(f) = sgn(g) when p = 1 and 
f =cg for some c>0 when p> 1. 
Proof. Since 
If + gl? < (2max((f],|g1))? = 2? max (|f|? ,|gl?) < 2? (If + |9/?) 
it follows that 
If + gb < 2? (IIFIIE + llgllb) < 00. 
In the case that p = 1, 


tah = f it tolaes f ites f lala 
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with equality iff 
lfl+lol=|ft+gl ae. <== sgn(f) =sgn(g) ae. 


Now assume that p > 1. We may assume || f + g]||, > 0 since if ||f + g||, = 0 the 
theorem is easily verified. Now 


lf+ol? =|ft+allf tol? < (fl +lodlf+oP 


with equality iff sen(f) = sgn(g) ae. Integrating this equation and applying 
Holder’s inequality gives 


i lf + 9|?du a If| PoP taut | lal |f + 9/? dp 
xX xX xX 


(14.2) < (lflle + llglle) If +91? ll 


with equality iff 
( IF| Vet idea jit lg! ) a 
Il fll I|f + 91?" lla Ilgllp 


and sen(f) = sgn(g) a.e. 


Now 


(14.3) Wistar = f Ue +or yan = fis + aay 
x bd 
wherein we have used Eq. (14.1), g(p — 1) = p. Combining Eqs. (14.2) and (14.3) 
implies 
(14.4) If +9115 <I fllllf + 9b’? + llglloll ft + gllb/4 
with equality iff 
sgn(f) = sgn(g) and 


IF | ys If +9)? =( lol ); 
a) (in: lf+ole Tole) *° 


Solving for || f+ ||» in Eq. (14.4) with the aid of Eq. (14.1) shows that ||f+||p < 
llfllo + llgllp with equality iff Eq. (14.5) holds which happens iff f = cg a.e. with 
c>0. 


Theorem 14.8 (Completeness of L?(j)). Suppose that {fn} C LP (us) is Cauchy, 


then there exists f € L? (1) such that fr = f. Moreover f is unique modulo the 
equivalence relation of being equal off sets of measure zero. 


1/p 
Isl=(flaPan) 
x 
By Chebyschev’s inequality, 


L(\fn a Ten Z €) _ E(\fn = fml” 2 é”) 


1 1 
as af \ta— fal de = allfn — Fml? — 0 as m,n > co 


Proof. Write 
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for all « > 0. This shows that { f,,} is L°-Cauchy (i.e. Cauchy in measure) so there 
exists {g;} C {fn} such that g; — f a.e. Now by Fatou’s Lemma, 


ag — FP = fim into — a? < ima int Yay — only 
00 k—o0o 


= lim inf ||g; — ge||? +0 as 7 > oo. 
k—oo 


In particular, || f|| < |lg; — f|| + |lg;|| < co so the f € L? and g; +", f. The proof 
is finished because, 


Il fn — fll S Ilfn — gall + lla — fl] > 0 as jn — 00. 


14.2. Corollaries of Hélder’s Inequality. The L?(j,:) — norm controls two types 
of behaviors of f, namely the “behavior at infinity” and the behavior of local singu- 
larities So in particular, if f is blowing up at a point x79 € X, then locally near xo it 
is harder for f € L?(1) as p increases. On the other hand a function f € L?() is al- 
lowed to decay at infinity slower and slower as p increases. With these “insights” in 
mind, we should not in general expect L? (yu) C L4 (js) or L4(41) C LP (ps). However, 
there are two notable exceptions that we shall prove below. (1) If u(X) < oo, then 
there is no behavior at infinity to worry about and we expect that L4(41) C L?() for 
all g < p. See Corollary 14.10 below. (2) If jz is counting measure, i.e. u(A) = #(A), 
then all functions in L?(j:) for any p can not blow up on a set of positive measure, 
so there are no local singularities. Hence we expect in this case that L? (js) C £7 (t) 
for all q < p, see Corollary 14.13 below. 


Corollary 14.9. Suppose that r,p,q € (0,00] are numbers such that 
1 1 1 
(14.6) ae eee 
roop gq 
then for measurable functions f,g:X — C, 


II fall < Wlfllp - Ilglla- 


Proof. The case r = co is easy and is left to the reader. So assume r € (0, ov). 
By Eq. (14.6), a = p/r and b = q/r are conjugate exponents. Thus by Hélder’s 
inequality, 


, 


IIfoll; =WV lolly SWIFT" We Wal” Ne = NFR! - halle’ 
from which the desired result follows. m 


Corollary 14.10. If p(X) < 00, then L?(u) C L4(u) for all0 <p <q < ow and 
the inclusion map is bounded. 


Proof. Choose a € [1, 0] such that 
5 ee Cer = 
—-=-+-, ie. gt 
Pp a@ 4 Pq 
Then by Corollary 14.9, 
oe 
fll =F Mlp SW Flla - Mle = eX)" Flla = HX) ES IF lle 


The reader may easily check this final formula is correct even when g = co provided 
we interpret (1/p—1/q) =1/p in this case. @ 
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Proposition 14.11. Suppose thatO <p<q<r<o, then LY Cc L? +L’, i.e 
every function f € LY may be written as f=g+h with g € L? andhe L’. 


Proof. The blow up points of f are contained in the set E := {|f| > 1} and the 
behavior of f at infinity is solely determined by f on E°. Hence let g = flg and 
h= flge so that f = g +h. By our discussion at the beginning of this section we 
expect that g € L? and he L’”. Indeed, 


lol” = [FP le = [FIP gpisay < 1S Lgisay < Il? 


which after integrating shows that ||g||? < || f||%. Similarly 


Jal” = [FI Lae =F Uiricay SF La sicay SFI 
so that ||hl| < File. 7 


Corollary 14.12. Suppose that0 <p<q<r<o, then LL" C L% and we 
have 


BN -r 
lflle < Ilfll Ill 

where A € (0,1) is determined so that 

i ee ane 

Lee ee with X= p/q ifr =o. 

q Pp r 

Proof. Let be determined as above, a = p/XA and b = r/(1 — A), then by 

Corollary 14.9, 


Illy = [ler eA sl ee = ae 


rT] 

Again, the heuristic explanation of this corollary is that if f € L? 9 L”, then 
f has local singularities no worse than an L” function and behavior at infinity no 
worse than an L? function. Hence f € L” for any q between p and r. 


Corollary 14.13. Suppose now that ws is counting measure. Then L” (js) C L9(t) 
for dl0<p<q<ow. 


Proof. Suppose that 0 < p< r =oo, then 


FR, =sup{lf(e)P 2 eX} < SU F@)P = ISI. 


cEeX 
Now apply Corollary 14.12 with r = oo to find 
v/a 1—p/q p/4q 1-p/q _ 
WF lla < MFM WF loo 7 SNF WF lip PO" = UF lp - 


14.2.1. Jensen’s Inequality. 


Definition 14.14. A function ¢ : (a,b) — R is convex if for all a < ap < a <b 
and t € [0,1] o(a) < tb(x1) + (1 — t)d(xo) where x, = ta; + (1—t)20. 
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[20 


es -4 2 0 2 
xX 
A convex function with along with two cords corresponding to 7p = —2 and 
a, =4 and x = —5 and x = —2. 


The following Proposition is clearly motivated by Figure 14.14. 


Proposition 14.15. Suppose that ¢: (a,b) > R is a convex function, then 
1. For all u,v,w,z € (a,b) such thatu <v,w<z,u<w and v < z we have 
aie o(v) = ow) - 0) = Hw), 
v-—U zZ-—w 
2. For each c € (a,b), the right and left sided derivatives ¢',(c) exists in R and 
ifa<u<u<b, then ¢,(u) < d_(v) < ov). 
3. The function ¢ is continuous. 
4. For all t € (a,b) there exists G@ © R such that ¢(x) > (t) + B(a — t) for all 
x € (a,b). 


Proof. 1a) Suppose first that u << v = w < z, in which case Eq. (14.7) is 
equivalent to 


(ov) — O(u)) (2 — v) S (P(2) — 6(@)) (&— w) 
which after solving for ¢(v) is equivalent to the following equations holding: 
v-—u zZ-—v 
< 
(0) < 2) + lw) 
But this last equation states that ¢(v) < ¢(z)t + ¢(u) (1—t) where t = 2=* and 
v =tz+(1-—t)u and hence is valid by the definition of ¢ being convex. 


1b) Now assume that Suppose first that u = w < v < z, in which case Eq. (14.7) 
is equivalent to 


zZ—U 


(ov) — b(u)) (2-4) S (Oz) — o(u)) (v — 4) 


which after solving for ¢(v) is equivalent to 


ov) (zu) < oz) (v—u) + O(u) (2 — ») 
which is equivalent to 
u zZ-v 


H(v) < )—— + o(u) 


u z-wu 


Again this equation is valid by the convexity of ¢. 
lc) u< w <v =z, in which case Eq. (14.7) is equivalent to 


(9(z) — b(u)) (2 — w) < (O(2) — o(w)) (2 — u) 
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and this is equivalent to the inequality, 
w-—u zZ-w 


p(w) < (2) + H(u) 


ZU zZ—U 


which again is true by the convexity of ¢. 
1) General case. If u< w <v < z, then by la-Ic) 


o(z) — ow) > b(v) — ow) . b(v) — o(u) 
andifu<v<w<z 
b(z) — ow) > o(w) = ov) > p(w) = ou) 


We have now taken care of all possible cases. 

2) On the set a < w < z < b, Eq. (14.7) shows that (¢(z) — 6(w)) /(z-—w) isa 
decreasing function in w and an increasing function in z and therefore ¢/, (7) exists 
for all x € (a,b). Also from Eq. (14.7) we learn that 


(14.8) $i, (u) < ote) ~ 0) for alla<u<w<z<b, 
(14.9) QO) OW) 2 a tek dig Cap ee Sh 


v-—U 
and letting w 7 z in the first equation also implies that 
f.(u) < ¢_(z) for alla<u<z<b. 


The inequality, 6_(z) < ¢/,(z), is also an easy consequence of Eq. (14.7). 

3) Since ¢() has both left and right finite derivatives, it follows that ¢ is con- 
tinuous. (For an alternative proof, see Rudin.) 

4) Given t, let 3 € [d_(t), ¢/,()], then by Eqs. (14.8) and (14.9), 


HO- 0) <<a <n < 9) 


for alla<u<t<z<b. Item 4. now follows. mg 


Corollary 14.16. Suppose ¢: (a,b) — R is differential then @ is convex iff o is 
non decreasing. In particular if ¢ € C?(a,b) then is convea iff ¢” > 0. 


Proof. By Proposition 14.15, if ¢ is convex then ¢’ is non-decreasing. Conversely 
if @ is increasing then 


(21) = (ce) = #' (€1) for some €; € (c, £1) 
Of Oe. 
and 
a) = (£0) = # (€2) for some £2 € (zo, c). 
C— Xo 
Hence 


P(x1) — o(c) — o(c) — (xo) 


Lie =~ C— Xo 


for all x9 < c < 21 from which it follows that ¢ is convex. m 


Example 14.17. The function exp(z) is convex , x? is convex iff p > 1 and 
—log(x) is convex. 
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Theorem 14.18 (Jensen’s Inequality). Suppose that (X,M,,) is a probability 
space, i.e. jt is a positive measure and p(X) = 1. Also suppose that f € L*(), 
f :X — (a,b), and ¢: (a,b) > R is a convex function. Then 


o( iE fan) < [ o(t)du 


where if pof ¢ L'(y), then pof is integrable in the eatended sense and f,, o(f)du = 
oo. 


Proof. Let t = J, fd € (a,b) and let @ € R such that ¢(s) — ¢(t) > G(s — t) 
for all s € (a,b). Then integrating the inequality, ¢(f) — o(t) > B(f —t), implies 


that 
o< f as Jd — ot) = fos du olf fay 


Moreover, if #(f) is not integrable, then ¢(f) > oy 3(f — t) which shows that 
negative part of ¢(f) is integrable. Therefore, [, ¢(f)dy = oo in this case. m 

As an application, we may use Corollary 14.16 a Theorem 14.18 to give another 
proof of Lemma 14.5. Let a =Ins and b= Int. Then by Jensen’s inequality, 


st — et) — e(Gsetpre) < 1 aa 1 pa = I a | le 


qd Pp q Pp 
with equality iff ga = pa iff si = t?. As a check 


st — ss4/P — gita/P — of 


so by Eq. (14.1) 
go - 84 st oP 


st = sf = | = + —, 
q Pp q Pp 


14.3. The Dual of L? spaces. Throughout this section we assume (X,M, ju) is 
a o-finite measure space, g € [1,00] and p € [1,00] are conjugate exponents, i.e. 
p-'+q-1=1. For g€ L’, let 4, € (L”)* be given by 


og(f) = fof dt. 


By Hoélder’s inequality 


(14.10) Ibo(f)I < ie la flay < llgllall flo 
which implies that 
(14.11) IlPgllize)* < Ilglla- 


We now show that the reverse inequality. 


Proposition 14.19. Keeping the notation above, for all g € L4, 


(14.12) IlPall(z»)= = II9lla- 
Proof. Assume first that g < oo so p > 1. We want equality to hold in (14.10) 


which happens iff 
lal \" fl \” 
gf|=agf and ( = a.e. 
a loll) ~ Tl 
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Therefore we should take | f| = II fllplal@/? /Ilglla” and sen(f)sen(g) = 1 so sgn(f) = 
sen(g). Therefore 


f =sen(f)If1 = sel” 


and since the constants are irrelevant for our purposes, let f = sgn(g)| g|/ P where 


gl’? = 1if qg=1 and p =oo. (Alternatively, just try f of the form f = sgn(g)|g|>. 
In order for f € L? we must choose A such that Ap = gq, i.e. A = g/p as above.) If 
p=, we find 


Ig(f)| = 1 gsen(a)dy = Il9llz.qay = llglla ll flloc 


which shows that ||¢g||(-0)+ > ||gll1. If p < 00, then 


ig = f iP = f lal? = lol 


while 
bof) = f ofdn= f lllalt?ay = f loltay = Vals 
Hence 
léoCf)| __llgll? patty _ 
lf \lp - \Ig||2 = |lglla = lalla 


This shows that ||¢,|| > ||g||q which combined with Eq. (14.11) implies Eq. (14.12). 

Now assume that p = 1 and q = oo and let ||g||,. = M. Choose X, € M such 
that X, | X as n — oo and p(X,,) < co for all n. For any € > 0, p(|g| => M—e) > 0 
and XM {|g| > M—e} T {|g| > M—e}. Therefore, p(X, {|g| > M —}) > 0 for 
n sufficiently large. Let 


f =sgn(g)1x,,Agigi>m—e}s 
then 
If lla = u(Xn  {g| = M — ef) € (0, 00). 


Moreover, 


lo (FI =i sentohody = [ lg\duu 
XnM{|g|>M—e} XnN{|g|2>M—e} 


> (M — €)u(XnN {|g| 2M — €}) = (M —)|If Il 


and this implies that ||¢g||(z1)» => M —e. Since € > 0 is arbitrary, it follows that 
IlPollcz1y* >M= II||o0. a! 


Theorem 14.20. Let (X,M, 1) be ac-finite measure space and suppose that p,q € 
[1,00] are conjugate exponents. Then for p © [1,0o), the map g € L4 — dy € 
(L?)* is an isometric isomorphism of Banach space. We summarize this by writing 
(L?)* = L4 for alll <p<o. 


Proof. The only point that we have not yet proved is the surjectivity of the 
map g € Lt — gy € (L”)*. (When p = 2 this follows from the general Hilbert space 
theory.) 
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Case 1. Assume p(X) < oo. Let ¢ € (L”)*. If 6 = ¢, for some g € L*4 then 
g € L' (by Holder’s inequality) and 


(14.13) ola) = | aay 


for all A € M. This suggests that we let A(A) = (1,4). Let us now show that \ is 
a complex measure and \ < pu. 
Suppose that A = ]]°%, A, with A, € M, then!® 


N 
[da 3 14, Ize = |[lus 4, An lle = [H(URLw414n)]? > 0 as N — ov. 
n=1 
Therefore 
(A) = 6(14) = 55 6(4,,) = 55 A(An). 
1 1 


Combining the last equation with the fact that A() = 0 implies that \ is a complex 
measure. Moreover if u(A) = 0, 14 = 0 in L? and thus, A(A) = ¢(14) = ¢(0) = 0 
showing \ < w. 

The Radon-Nikodym theorem now implies there exists g = d\/du € L'(). Then 
for this g, Eq. (14.18) is valid for all A € M and then by linearity we find 


(14.14) o(f) = a fodp for all fe S$ 


where S$ is the space of complex valued simple functions on X. Given a bounded 
measurable function g on X, let fy, € S such that |f,| <|f| and f, — f pointwise 
as n — oo. By the dominated convergence theorem, f,, — f in L?() and therefore, 


(14.18) (f) = fim. (fn) = jim. faadw =f fod 


and Eq. (14.14) holds for all bounded measurable functions f. We will now show 
that g € L4(1). 

Given M < oo, let du(f) :-= O(lgi<umf). Then for f ¢ L°, we have by Eq. 
(14.15) that 


bulf) =f faligierrde = boas(P) 
x 
where gv := glijgj<m € L® C L?” for all p > 1. Moreover, 


loa (F)| < [PC gicuf)] < ll |Ligicar fll, < Well fle 
so that ||¢a||(r0)* < Kallen . Since L°° (1) is dense in L?, it follows that das = dgy, 
for all M < oo. By Proposition 14.19, we learn 
lanelly = lleaellezm» < lbllezey 


Fatou’s lemma or the dominated convergence theorem now allows us to let M — oo 
to conclude that ||g||, < ||¢lly eye Once we know this, it again follows from Eq. 
(14.15) and the density of L° c L” that ¢ = ¢y. 


161t is at this point that the proof breaks down when p = oo. 
17The argument leading to this conclusion may be replaced by the reverse Holder inequality 
of Theorem 14.22 below. 
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Case 2. Now suppose that py is o-finite and X, € M are sets such that 0 < 
p( Xp) < co and X = J] X,. Identify L?(Xn, Mn, fn) with 
n=1 


{f € IP(X,.M, p)) + f =0 on ES}. 
So ¢|z»(x,,) is still bounded on L?(X,,) and hence by Case 1. there exists gn € 
L4(Xp,) such that ¢|20(xX,,,u,) = ?g, On L?(Xn, pn) for all n. Define g = 3 In- 
Notice that a 


N 
P| be(uX_, Xn) =n on L?( U Xn) 


and this implies that 


N 
(14.16) Io gnlla = llenux,x.yll $ lial 


n=1 
n=1 


for all N. Since {g,};—_, have disjoint supports, 


N 


N 
| So onl = So lanl T Ig as N — oo 
n=1 


n=1 


and so we may pass to the limit in Eq. (14.16) using the monotone convergence 
theorem to show 


oo N 
Il9\la = I ddl = Nim. | dll < lPll(zey* < OO. 
n= n= 


Each f € L®(X) decomposes as f = 5> f Lx, and by the dominated convergence 
n=1 
theorem implies, 


N 


leas SS fix, 
1 


p=\|lf (1 = Luss is Xn } |p ~0as N— oo. 
Hence 


9(f) = >2 9(F1x,.) = So bo(flx,.) = b0(F) 


since ¢(f) = ¢,(f) for all f € L?(X,,) and ¢ and ¢, are continuous on L?(X). @ 
Theorem 14.22 fails in general when p = oo. 


Example 14.21. Consider X = [0,1], M = B, and wp =m. Then (L&)* 4 L?. 


Proof. Let M := C((0,1])* c ”L™ (0, 1], dm). It is easily seen for f € M, that 
\|f\loo = sup { f(a) : x € [0,1]} for all f € M. Therefore M is a closed subspace of 
L®. Define €(f) = f(0) for all f € M. Then @ € M* with norm 1. By the Hahn- 
Banach theorem there exists an extension L € (L°)* such that L = @ on M and 
\|L|| = 1. Suppose that there exists g € L1 such that 


L(f) = ¢(f) =[., fgdm for all f € L&. 
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Let f(x) = (1— na) ly<n-1, then L(f,) = 1 for all n and hence 


nm—Co 


l= dim, L(fn) = im, f fngdm = ie gdm = 0, 
[0,1] 


wherein we have made use of the Dominated convergence theorem in the second to 
last equality. From this contradiction, we conclude that L 4 ¢, for any g € L'. @ 


14.4. Converse of Hélder’s Inequality. 


Theorem 14.22 (Converse of Hélder’s Inequality). Assume that (X,M,U) is ao 
— compact measure space, q € [1,00] and p be the corresponding conjugate exponent. 
Also let S denote the set of simply functions f on X such that u(f #0) < oo. For 
g:X —C measurable such that fg € L' for all f € S,'8 let 


(14.17) Mq(9) =sup{ a fais $8 with |fl, =1\. 


If Mg(g) < co then g € L4 and M,(g) = \lgll, - 


Proof. As above, let X, € M be sets such that ~(X,) < co and X, — X as 
n J oo. Suppose that g = 1 and hence p = oo. Choose simple functions f, on X such 
that |f,| < 1 and sgn(g) = lim, f, in the pointwise sense. Then lx, fn, € S 
and therefore 


| | 1x. fod < M,(g9) 
xX 


for all m,n. By assumption 1x, g € L'() and therefore by the dominated conver- 
gence theorem we may let n — oo in this equation to find 


if xy, 
xX 


for all m. The monotone convergence theorem then implies that 
[lola = tim, f 1x, \aldu < MoCo) 
xX n—oo xX 


showing g € L'() and ||g||; < Mg(g). Since Holder’s inequality implies that 
M,(g) < ||g||, , we have proved the theorem in case g = 1. 

For q > 1, we will begin by assuming that g € L4(). Since p € [1, 00) we know 
that S' is a dense subspace of L?(j) and therefore 


M,(9) = su | [ fat  f € P>(u) with [Ifll, = i} idl: 


where the last equality follows by Proposition 14.19. 

So it remains to show that if fg € L' for all f € S and M,(g) < o then 
g € L4(u). For n €N, let gp = 1x, lg)<ng. Then gn € L4(u), in fact ||gn|lq < 
npi(X,)1/% < co. So by the previous paragraph, 


gl du < M,(g) 


gall = Mq(an) =s0p 4] [ Fx, lpenad f € L>(u) with ||fll, =1} 


s Ma(g ) ||f1x,. Lai<nl|, < = M,(9) 


18This is equivalent to requiring 14g € L1(y) for all A € M such that p(A) < oo. 


MATH 240B LECTURE NOTES: TOPOLOGY AND FUNCTIONAL ANALYSIS 91 


wherein the second to last inequality we have made use of the definition of M,(g) 
and the fact that flx, Igi<cn € S. If q € (1,00), an application of the monotone 
convergence theorem (or Fatou’s Lemma) now shows that 


IIgllq = im Ign llq < Ma(g) < 00. 


And if q = ov, then ||gn|loo < Mg(g) < co for all n implies |g, | << Mg(g) ae. which 
then implies that |g| < M,(g) a.e. since |g| = limp—oo |gn|. That is g € LD () and 
IITlloo S Moo(g). 


